Markov Decision Process Modeling for Multi-stage Optimization of Intervention and Treatment Strategies in Breast Cancer

Farhad Imani, Zihang Qiu, Hui Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The breast cancer is a prevalent problem that undermines quality of patients' lives and causes significant impacts on psychosocial wellness. Advanced sensing provides unprecedented opportunities to develop smart cancer care. The available sensing data captured from individuals enable the extraction of information pertinent to the breast cancer conditions to construct efficient and personalized intervention and treatment strategies. This research develops a novel sequential decision-making framework to determine optimal intervention and treatment planning for breast cancer patients. We design a Markov decision process (MDP) model for both objectives of intervention and treatment costs as well as quality adjusted life years (QALYs) with the data-driven and state-dependent intervention and treatment actions. The state space is defined as a vector of age, health status, prior intervention, and treatment plans. Also, the action space includes wait, prophylactic surgery, radiation therapy, chemotherapy, and their combinations. Experimental results demonstrate that prophylactic mastectomy and chemotherapy are more effective than other intervention and treatment plans in minimizing the expected cancer cost of 25 to 60 years-old patient with in-situ stage of cancer. However, wait policy leads to an optimal quality of life for a patient with the same state. The proposed MDP framework can also be generally applicable to a variety of medical domains that entail evidence-based decision making.

Original languageEnglish (US)
Title of host publication42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
Subtitle of host publicationEnabling Innovative Technologies for Global Healthcare, EMBC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5394-5397
Number of pages4
ISBN (Electronic)9781728119908
DOIs
StatePublished - Jul 2020
Event42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 - Montreal, Canada
Duration: Jul 20 2020Jul 24 2020

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2020-July
ISSN (Print)1557-170X

Conference

Conference42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
CountryCanada
CityMontreal
Period7/20/207/24/20

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint Dive into the research topics of 'Markov Decision Process Modeling for Multi-stage Optimization of Intervention and Treatment Strategies in Breast Cancer'. Together they form a unique fingerprint.

  • Cite this

    Imani, F., Qiu, Z., & Yang, H. (2020). Markov Decision Process Modeling for Multi-stage Optimization of Intervention and Treatment Strategies in Breast Cancer. In 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020 (pp. 5394-5397). [9175905] (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2020-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC44109.2020.9175905