Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Deep Learning Based Cardiac Cine Segmentation – Transfer Learning Application to 7T Ultrahigh-Field MRI

View ORCID ProfileMarkus Johannes Ankenbrand, View ORCID ProfileDavid Lohr, Wiebke Schlötelburg, Theresa Reiter, Tobias Wech, View ORCID ProfileLaura Maria Schreiber
doi: https://doi.org/10.1101/2020.06.15.20131656
Markus Johannes Ankenbrand
1Chair of Cellular and Molecular Imaging, Comprehensive Heart Failure Center (CHFC), University Hospital Wuerzburg, Wuerzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Markus Johannes Ankenbrand
  • For correspondence: Ankenbrand_M{at}ukw.de
David Lohr
1Chair of Cellular and Molecular Imaging, Comprehensive Heart Failure Center (CHFC), University Hospital Wuerzburg, Wuerzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David Lohr
Wiebke Schlötelburg
1Chair of Cellular and Molecular Imaging, Comprehensive Heart Failure Center (CHFC), University Hospital Wuerzburg, Wuerzburg, Germany
2Department of Radiology, University Hospital Wuerzburg, Wuerzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Theresa Reiter
1Chair of Cellular and Molecular Imaging, Comprehensive Heart Failure Center (CHFC), University Hospital Wuerzburg, Wuerzburg, Germany
3Department of Internal Medicine I, University Hospital Wuerzburg, Wuerzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tobias Wech
2Department of Radiology, University Hospital Wuerzburg, Wuerzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laura Maria Schreiber
1Chair of Cellular and Molecular Imaging, Comprehensive Heart Failure Center (CHFC), University Hospital Wuerzburg, Wuerzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Laura Maria Schreiber
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Artificial neural networks show promising performance in automatic segmentation of cardiac MRI. However, training requires large amounts of annotated data and generalization to different vendors, field strengths, sequence parameters, and pathologies is limited. Transfer learning addresses this challenge, but specific recommendations regarding type and amount of data required is lacking. In this study we assess data requirements for transfer learning to experimental cardiac MRI at 7T where the segmentation task can be challenging. In addition, we provide guidelines, tools, and annotated data to enable transfer learning approaches by other researchers and clinicians.

Methods A publicly available segmentation model was used to annotate a publicly available data set. This labelled data set was subsequently used to train a neural network for segmentation of left ventricle and myocardium in cardiac cine MRI. The network is used as starting point for transfer learning to 7T cine data of healthy volunteers (n=22; 7873 images). Structured and random data subsets of different sizes were used to systematically assess data requirements for successful transfer learning.

Results Inconsistencies in the publically available data set were corrected, labels created, and a neural network trained. On 7T cardiac cine images the initial model achieved DICELV=0.835 and DICEMY=0.670. Transfer learning using 7T cine data and ImageNet weight initialization improved model performance to DICELV=0.900 and DICEMY=0.791. Using only end-systolic and end-diastolic images reduced training data by 90%, with no negative impact on segmentation performance (DICELV=0.908, DICEMY=0.805).

Conclusions This work demonstrates and quantifies the benefits of transfer learning for cardiac cine image segmentation. We provide practical guidelines for researchers planning transfer learning projects in cardiac MRI and make data, models and code publicly available.

Competing Interest Statement

The work was supported by a grant from German Ministry of Education and Research (01EO1504). The Department of TW (Department of Diagnostic and Interventional Radiology, University Hospital, Wuerzburg, Germany) revceives a research grant from Siemens Healthcare GmbH.

Funding Statement

The work was supported by a grant from German Ministry of Education and Research (01EO1504).

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study was approved by the local ethics committee at the University Hospital Wuerzburg (7/17-SC)

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Parts of this work will be used in the doctoral thesis of David Lohr

    Parts of this work have been accepted at the ISMRM 2020.

  • Incoroporated multiple small improvements and clarifications based on reviewer feedback.

Data Availability

Data used and generated in this study is available at Zenodo. Source code, models and detailed instructions for reproducibility are available at GitHub and archived at Zenodo. Due to data privacy regulations the 7T MR images are not publically available.

https://doi.org/10.5281/zenodo.3876351

https://github.com/chfc-cmi/cmr-seg-tl

https://doi.org/10.5281/zenodo.3894646

  • List of abbreviations

    LV
    left ventricle
    RV
    right ventricle
    EF
    ejection fraction
    ESV
    end-systolic volume
    EDV
    end-diastolic volume
    lr
    learning rate
    UKBB
    UK Biobank
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
    Back to top
    PreviousNext
    Posted November 16, 2020.
    Download PDF
    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Deep Learning Based Cardiac Cine Segmentation – Transfer Learning Application to 7T Ultrahigh-Field MRI
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Deep Learning Based Cardiac Cine Segmentation – Transfer Learning Application to 7T Ultrahigh-Field MRI
    Markus Johannes Ankenbrand, David Lohr, Wiebke Schlötelburg, Theresa Reiter, Tobias Wech, Laura Maria Schreiber
    medRxiv 2020.06.15.20131656; doi: https://doi.org/10.1101/2020.06.15.20131656
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    Deep Learning Based Cardiac Cine Segmentation – Transfer Learning Application to 7T Ultrahigh-Field MRI
    Markus Johannes Ankenbrand, David Lohr, Wiebke Schlötelburg, Theresa Reiter, Tobias Wech, Laura Maria Schreiber
    medRxiv 2020.06.15.20131656; doi: https://doi.org/10.1101/2020.06.15.20131656

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Radiology and Imaging
    Subject Areas
    All Articles
    • Addiction Medicine (427)
    • Allergy and Immunology (753)
    • Anesthesia (220)
    • Cardiovascular Medicine (3284)
    • Dentistry and Oral Medicine (362)
    • Dermatology (275)
    • Emergency Medicine (478)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1166)
    • Epidemiology (13346)
    • Forensic Medicine (19)
    • Gastroenterology (898)
    • Genetic and Genomic Medicine (5137)
    • Geriatric Medicine (480)
    • Health Economics (781)
    • Health Informatics (3260)
    • Health Policy (1140)
    • Health Systems and Quality Improvement (1189)
    • Hematology (428)
    • HIV/AIDS (1015)
    • Infectious Diseases (except HIV/AIDS) (14615)
    • Intensive Care and Critical Care Medicine (910)
    • Medical Education (476)
    • Medical Ethics (126)
    • Nephrology (522)
    • Neurology (4907)
    • Nursing (262)
    • Nutrition (725)
    • Obstetrics and Gynecology (880)
    • Occupational and Environmental Health (795)
    • Oncology (2517)
    • Ophthalmology (722)
    • Orthopedics (280)
    • Otolaryngology (347)
    • Pain Medicine (323)
    • Palliative Medicine (90)
    • Pathology (540)
    • Pediatrics (1299)
    • Pharmacology and Therapeutics (548)
    • Primary Care Research (554)
    • Psychiatry and Clinical Psychology (4196)
    • Public and Global Health (7488)
    • Radiology and Imaging (1703)
    • Rehabilitation Medicine and Physical Therapy (1010)
    • Respiratory Medicine (979)
    • Rheumatology (479)
    • Sexual and Reproductive Health (495)
    • Sports Medicine (424)
    • Surgery (547)
    • Toxicology (72)
    • Transplantation (235)
    • Urology (203)