Abstract
Purpose Currently, selection of patients for sequential vs. concurrent chemotherapy/radiation regimens lacks evidentiary support, and it is based on locally-optimal decisions for each step. We aim to optimize the multi-step treatment of head and neck cancer patients and to predict multiple patient survival and toxicity outcomes, and we develop, apply, and evaluate a first application of deep-Q-learning (DQL) and simulation to this problem.
Patients and methods The treatment decision DQL digital twin and the patient’s digital twin were created, trained and evaluated on a dataset of 536 oropharyngeal squamous cell carcinoma (OPC) patients with the goal of, respectively, determining the optimal treatment decisions with respect to survival and toxicity metrics, and predicting the outcomes of the optimal treatment on the patient. The models were trained on a subset of 402 patients (split randomly) and evaluated on a separate set of 134 patients. Training and evaluation of the digital twin dyad was completed in August 2020. The dataset includes 3-step sequential treatment decisions and complete relevant history of the patients cohort treated at MD Anderson Cancer Center between 2005 and 2013, with radiomics analysis performed for the segmented primary tumor volumes.
Results On the validation set, 87.09% mean and 90.85% median accuracy in treatment outcome prediction, matching the clinicians’ outcomes and improving (predicted) survival rate by +3.73% (95% CI: [-0.75%, +8.96%]), and dysphagia rate by +0.75% (CI: [-4.48%, +6.72%]) when following DQL treatment decisions.
Conclusion Given the prediction accuracy and predicted improvement on medically relevant outcomes yielded by this approach, this digital twin dyad of the patient-physician dynamic treatment problem has the potential of aiding physicians in determining the optimal course of treatment and in assessing its outcomes.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was directly supported by the National Institutes of Health [NCI-R01-CA214825, NCI-R01CA225190] and the National Science Foundation [CNS-1625941, CNS-1828265]. Direct infrastructure support is provided for this project by the multidisciplinary Stiefel Oropharyngeal Research Fund of the University of Texas MD Anderson Cancer Center Charles and Daneen Stiefel Center for Head and Neck Cancer, the MD Anderson Cancer Center Support Grant (P30CA016672), and the MD Anderson Program in Image-guided Cancer Therapy. Dr. Fuller received/receives funding and salary support unrelated to this project during the period of study execution from: the National Institutes of Health [R25EB025787-01; 1R01DE025248/R56DE025248; R01DE028290);1R01CA218148; P30CA016672; P50 CA097007]; NSF [1933369]; and the Sabin Family Foundation. Dr. Fuller has received unrelated direct industry grant support, honoraria, and travel funding from Elekta AB unrelated to this project.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The UIC Office for the Protection of Research Subjects received the Determination of Whether an Activity Represents Human Subjects Research application, and has determined that this activity DOES NOT meet the definition of human subject research at UIC as defined by 45 CFR 46.102(f). Specifically, this project uses de-identified data collected at U of Texas under institutional IRBs, and transferred to UIC under a Material Transfer Agreement. No new data is collected or generated at UIC. The U of Texas has a similar agreement with U of Iowa. No data is exchanged or shared between UIC and U Iowa.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵† Contributing authors
Data Availability
The dataset used in the data analysis is publicly available.
