Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Fully-automated sarcopenia assessment in head and neck cancer: development and external validation of a deep learning pipeline

View ORCID ProfileZezhong Ye, Anurag Saraf, Yashwanth Ravipati, Frank Hoebers, Yining Zha, Anna Zapaishchykova, Jirapat Likitlersuang, Roy B. Tishler, Jonathan D. Schoenfeld, Danielle N. Margalit, Robert I. Haddad, View ORCID ProfileRaymond H. Mak, Mohamed Naser, Kareem A. Wahid, Jaakko Sahlsten, Joel Jaskari, Kimmo Kaski, Antti A. Mäkitie, View ORCID ProfileClifton D. Fuller, Hugo J.W.L. Aerts, Benjamin H. Kann
doi: https://doi.org/10.1101/2023.03.01.23286638
Zezhong Ye
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Zezhong Ye
Anurag Saraf
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yashwanth Ravipati
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frank Hoebers
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
3Department of Radiation Oncology (Maastro), GROW School for Oncology and Reproduction, Maastricht University Medical Center+, Maastricht, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yining Zha
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anna Zapaishchykova
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
8Department of Radiology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jirapat Likitlersuang
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Roy B. Tishler
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan D. Schoenfeld
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Danielle N. Margalit
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert I. Haddad
4Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Raymond H. Mak
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Raymond H. Mak
Mohamed Naser
5Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kareem A. Wahid
5Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jaakko Sahlsten
6Department of Computer Science, Aalto University School of Science, Espoo, Finland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joel Jaskari
6Department of Computer Science, Aalto University School of Science, Espoo, Finland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kimmo Kaski
6Department of Computer Science, Aalto University School of Science, Espoo, Finland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Antti A. Mäkitie
7Department Otorhinolaryngology – Head and Neck Surgery, University of Helsinki and Helsinki University Hospital, Research Program in Systems Oncology, Faculty of Medicine, University of Helsinki, Helsinki, Finland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Clifton D. Fuller
5Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Clifton D. Fuller
Hugo J.W.L. Aerts
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
7Department Otorhinolaryngology – Head and Neck Surgery, University of Helsinki and Helsinki University Hospital, Research Program in Systems Oncology, Faculty of Medicine, University of Helsinki, Helsinki, Finland
8Department of Radiology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin H. Kann
1Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
2Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: Benjamin_Kann{at}dfci.harvard.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Purpose Sarcopenia is an established prognostic factor in patients diagnosed with head and neck squamous cell carcinoma (HNSCC). The quantification of sarcopenia assessed by imaging is typically achieved through the skeletal muscle index (SMI), which can be derived from cervical neck skeletal muscle (SM) segmentation and cross-sectional area. However, manual SM segmentation is labor-intensive, prone to inter-observer variability, and impractical for large-scale clinical use. To overcome this challenge, we have developed and externally validated a fully-automated image-based deep learning (DL) platform for cervical vertebral SM segmentation and SMI calculation, and evaluated the relevance of this with survival and toxicity outcomes.

Materials and Methods 899 patients diagnosed as having HNSCC with CT scans from multiple institutes were included, with 335 cases utilized for training, 96 for validation, 48 for internal testing and 393 for external testing. Ground truth single-slice segmentations of SM at the C3 vertebra level were manually generated by experienced radiation oncologists. To develop an efficient method of segmenting the SM, a multi-stage DL pipeline was implemented, consisting of a 2D convolutional neural network (CNN) to select the middle slice of C3 section and a 2D U-Net to segment SM areas. The model performance was evaluated using the Dice Similarity Coefficient (DSC) as the primary metric for the internal test set, and for the external test set the quality of automated segmentation was assessed manually by two experienced radiation oncologists. The L3 skeletal muscle area (SMA) and SMI were then calculated from the C3 cross sectional area (CSA) of the auto-segmented SM. Finally, established SMI cut-offs were used to perform further analyses to assess the correlation with survival and toxicity endpoints in the external institution with univariable and multivariable Cox regression.

Results DSCs for validation set (n = 96) and internal test set (n = 48) were 0.90 (95% CI: 0.90 – 0.91) and 0.90 (95% CI: 0.89 - 0.91), respectively. The predicted CSA is highly correlated with the ground-truth CSA in both validation (r = 0.99, p < 0.0001) and test sets (r = 0.96, p < 0.0001). In the external test set (n = 377), 96.2% of the SM segmentations were deemed acceptable by consensus expert review. Predicted SMA and SMI values were highly correlated with the ground-truth values, with Pearson r β 0.99 (p < 0.0001) for both the female and male patients in all datasets. Sarcopenia was associated with worse OS (HR 2.05 [95% CI 1.04 - 4.04], p = 0.04) and longer PEG tube duration (median 162 days vs. 134 days, HR 1.51 [95% CI 1.12 - 2.08], p = 0.006 in multivariate analysis.

Conclusion We developed and externally validated a fully-automated platform that strongly correlates with imaging-assessed sarcopenia in patients with H&N cancer that correlates with survival and toxicity outcomes. This study constitutes a significant stride towards the integration of sarcopenia assessment into decision-making for individuals diagnosed with HNSCC.

SUMMARY STATEMENT In this study, we developed and externally validated a deep learning model to investigate the impact of sarcopenia, defined as the loss of skeletal muscle mass, on patients with head and neck squamous cell carcinoma (HNSCC) undergoing radiotherapy. We demonstrated an efficient, fullyautomated deep learning pipeline that can accurately segment C3 skeletal muscle area, calculate cross-sectional area, and derive a skeletal muscle index to diagnose sarcopenia from a standard of care CT scan. In multi-institutional data, we found that pre-treatment sarcopenia was associated with significantly reduced overall survival and an increased risk of adverse events. Given the increased vulnerability of patients with HNSCC, the assessment of sarcopenia prior to radiotherapy may aid in informed treatment decision-making and serve as a predictive marker for the necessity of early supportive measures.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

The authors acknowledge support from the National Institutes of Health (NIH) with grant numbers (NIH U24CA194354, NIH U01CA190234, NIH U01CA209414, NIH R35CA22052, NIH K08DE030216, NIH 5F31DE031502-02), the European Union-European Research Council (866504), and the Radiological Society of North America. All analyses and conclusions in this manuscript are the sole responsibility of the authors and do not necessarily reflect the opinions or views of the clinical trial investigators, the NCTN, or the NCI.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This study was conducted in accordance with the Declaration of Helsinki guidelines and following the Mass General Brigham (MGB) Institutional Review Board (IRB) approval. Waiver of consent was obtained from the MGB IRB prior to research initiation.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • Figure numbers updated in both results section and figure captions.

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted March 06, 2023.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Fully-automated sarcopenia assessment in head and neck cancer: development and external validation of a deep learning pipeline
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Fully-automated sarcopenia assessment in head and neck cancer: development and external validation of a deep learning pipeline
Zezhong Ye, Anurag Saraf, Yashwanth Ravipati, Frank Hoebers, Yining Zha, Anna Zapaishchykova, Jirapat Likitlersuang, Roy B. Tishler, Jonathan D. Schoenfeld, Danielle N. Margalit, Robert I. Haddad, Raymond H. Mak, Mohamed Naser, Kareem A. Wahid, Jaakko Sahlsten, Joel Jaskari, Kimmo Kaski, Antti A. Mäkitie, Clifton D. Fuller, Hugo J.W.L. Aerts, Benjamin H. Kann
medRxiv 2023.03.01.23286638; doi: https://doi.org/10.1101/2023.03.01.23286638
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Fully-automated sarcopenia assessment in head and neck cancer: development and external validation of a deep learning pipeline
Zezhong Ye, Anurag Saraf, Yashwanth Ravipati, Frank Hoebers, Yining Zha, Anna Zapaishchykova, Jirapat Likitlersuang, Roy B. Tishler, Jonathan D. Schoenfeld, Danielle N. Margalit, Robert I. Haddad, Raymond H. Mak, Mohamed Naser, Kareem A. Wahid, Jaakko Sahlsten, Joel Jaskari, Kimmo Kaski, Antti A. Mäkitie, Clifton D. Fuller, Hugo J.W.L. Aerts, Benjamin H. Kann
medRxiv 2023.03.01.23286638; doi: https://doi.org/10.1101/2023.03.01.23286638

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Oncology
Subject Areas
All Articles
  • Addiction Medicine (427)
  • Allergy and Immunology (753)
  • Anesthesia (220)
  • Cardiovascular Medicine (3281)
  • Dentistry and Oral Medicine (362)
  • Dermatology (274)
  • Emergency Medicine (478)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1164)
  • Epidemiology (13340)
  • Forensic Medicine (19)
  • Gastroenterology (896)
  • Genetic and Genomic Medicine (5130)
  • Geriatric Medicine (479)
  • Health Economics (781)
  • Health Informatics (3253)
  • Health Policy (1138)
  • Health Systems and Quality Improvement (1189)
  • Hematology (427)
  • HIV/AIDS (1014)
  • Infectious Diseases (except HIV/AIDS) (14613)
  • Intensive Care and Critical Care Medicine (910)
  • Medical Education (475)
  • Medical Ethics (126)
  • Nephrology (522)
  • Neurology (4900)
  • Nursing (261)
  • Nutrition (725)
  • Obstetrics and Gynecology (879)
  • Occupational and Environmental Health (795)
  • Oncology (2516)
  • Ophthalmology (722)
  • Orthopedics (280)
  • Otolaryngology (346)
  • Pain Medicine (323)
  • Palliative Medicine (90)
  • Pathology (539)
  • Pediatrics (1297)
  • Pharmacology and Therapeutics (548)
  • Primary Care Research (554)
  • Psychiatry and Clinical Psychology (4193)
  • Public and Global Health (7482)
  • Radiology and Imaging (1702)
  • Rehabilitation Medicine and Physical Therapy (1010)
  • Respiratory Medicine (979)
  • Rheumatology (478)
  • Sexual and Reproductive Health (495)
  • Sports Medicine (424)
  • Surgery (546)
  • Toxicology (71)
  • Transplantation (235)
  • Urology (203)