Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Multiple sclerosis cortical lesion detection with deep learning at ultra-high-field MRI

View ORCID ProfileFrancesco La Rosa, View ORCID ProfileErin S. Beck, View ORCID ProfileJosefina Maranzano, View ORCID ProfileRamona-Alexandra Todea, View ORCID ProfilePeter van Gelderen, View ORCID ProfileJacco A. de Zwart, Nicholas J. Luciano, Jeff H. Duyn, View ORCID ProfileJean-Philippe Thiran, View ORCID ProfileCristina Granziera, View ORCID ProfileDaniel S. Reich, View ORCID ProfilePascal Sati, View ORCID ProfileMeritxell Bach Cuadra
doi: https://doi.org/10.1101/2022.03.02.22271269
Francesco La Rosa
1Signal Processing Laboratory (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
2CIBM Center for Biomedical Imaging, Switzerland
3Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Francesco La Rosa
  • For correspondence: francesco.larosa@epfl.ch
Erin S. Beck
3Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
4Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Erin S. Beck
Josefina Maranzano
5Department of Anatomy, University of Quebec in Trois-Rivières, Trois-Rivières, QC, Canada
6McConnell Brain Imaging Center, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, QC, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Josefina Maranzano
Ramona-Alexandra Todea
7Department of Neuroradiology, Clinic of Radiology and Nuclear Medicine, University Hospital of Basel, Basel, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ramona-Alexandra Todea
Peter van Gelderen
8Advanced MRI Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Peter van Gelderen
Jacco A. de Zwart
8Advanced MRI Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jacco A. de Zwart
Nicholas J. Luciano
3Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jeff H. Duyn
8Advanced MRI Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean-Philippe Thiran
1Signal Processing Laboratory (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
2CIBM Center for Biomedical Imaging, Switzerland
9Radiology Department, Lausanne University and University Hospital, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jean-Philippe Thiran
Cristina Granziera
10Translational Imaging in Neurology (ThINk) Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland
11Neurologic Clinic and Policlinic, Departments of Medicine, Clinical Research and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Cristina Granziera
Daniel S. Reich
3Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Daniel S. Reich
Pascal Sati
3Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
12Department of Neurology, Cedars-Sinai Medical Center, Los Angeles, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Pascal Sati
Meritxell Bach Cuadra
2CIBM Center for Biomedical Imaging, Switzerland
9Radiology Department, Lausanne University and University Hospital, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Meritxell Bach Cuadra
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Manually segmenting multiple sclerosis (MS) cortical lesions (CL) is extremely time-consuming, and past studies have shown only moderate inter-rater reliability. To accelerate this task, we developed a deep learning-based framework (CLAIMS: Cortical Lesion Artificial Intelligence-based assessment in Multiple Sclerosis) for the automated detection and classification of MS CL with 7T MRI.

Two 7T datasets, acquired at different sites, were considered. The first consisted of 60 scans that include 0.5mm isotropic MP2RAGE acquired 4 times (MP2RAGEx4), 0.7mm MP2RAGE, 0.5mm T2*-weighted GRE, and 0.5mm T2*-weighted EPI. The second dataset consisted of 20 scans including only 0.75×0.75×0.9 mm MP2RAGE. CLAIMS was first evaluated using 6-fold cross-validation with single and multi-contrast 0.5mm MRI input. Second, performance of the model was tested on 0.7mm MP2RAGE images after training with either 0.5mm MP2RAGEx4, 0.7mm MP2RAGE, or alternating the two. Third, its generalizability was evaluated on the second external dataset and compared with a state-of-the-art technique based on partial volume estimation and topological constraints (MSLAST). CLAIMS trained only with MP2RAGEx4 achieved comparable results to the multi-contrast model, reaching a CL true positive rate of 74% with a false positive rate of 30%. Detection rate was excellent for leukocortical and subpial lesions (83%, and 70%, respectively), whereas it reached 53% for intracortical lesions. The correlation between disability measures and CL count was similar for manual and CLAIMS lesion counts. Applying a domain-scanner adaptation approach and testing CLAIMS on the second dataset, the performance was superior to MSLAST when considering a minimum lesion volume of 6μL (lesion-wise detection rate of 71% vs 48%).

The proposed framework outperforms previous state-of-the-art methods for automated CL detection across scanners and protocols. In the future, CLAIMS may be useful to support clinical decisions at 7T MRI, especially in the field of diagnosis and differential diagnosis of multiple sclerosis patients.

Competing Interest Statement

DSR: Research support from Abata, Sanofi-Genzyme, and Vertex. CG: The University Hospital Basel (USB), as the employer of C.G., has received the following fees which were used exclusively for research support: (i) advisory board and consultancy fees from Actelion, Genzyme-Sanofi, Novartis, GeNeuro, and Roche; (ii) speaker fees from Genzyme-Sanofi, Novartis, GeNeuro and Roche; (iii) research support from Siemens, GeNeuro, Roche. For the remaining authors, none were declared.

Funding Statement

F.L.R. is supported by the European Union Horizon 2020 research and innovation program under the Marie Sklodowska-Curie project TRABIT (agreement No 765148) and the Novartis Research Foundation. E.S.B. is supported by a Career Transition Fellowship from the National Multiple Sclerosis Society. P.S., E.S.B., P.v.G., J.A.d.Z. and D.S.R. are supported by the Intramural Research Program of the National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, Maryland, USA.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study was approved by the Institutional Review Board of both the National Institute of Health (NIH) and Lausanne University Hospital (CHUV), and all patients gave written informed consent prior to participation.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Conflicts of Interest and Source of Funding: F.L.R. is supported by the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie project TRABIT (agreement No 765148) and the Novartis Research Foundation. E.S.B. is supported by a Career Transition Fellowship from the National Multiple Sclerosis Society. P.S., E.S.B., P.v.G., J.A.d.Z. and D.S.R. are supported by the Intramural Research Program of the National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, Maryland, USA. DSR: Research support from Abata, Sanofi-Genzyme, and Vertex. CG: The University Hospital Basel (USB), as the employer of C.G., has received the following fees which were used exclusively for research support: (i) advisory board and consultancy fees from Actelion, Genzyme-Sanofi, Novartis, GeNeuro, and Roche; (ii) speaker fees from Genzyme-Sanofi, Novartis, GeNeuro and Roche; (iii) research support from Siemens, GeNeuro, Roche. For the remaining authors, none were declared.

Data Availability

All data produced in the present study are available upon reasonable request to the authors.

  • Abbreviations

    MS
    multiple sclerosis
    GM
    gray matter
    WM
    white matter
    CL
    cortical lesions
    WML
    white matter lesions
    MRI
    magnetic resonance imaging
    3D
    three-dimensional
    T2* EPI
    T2*-weighted segmented echo-planar imaging
    T2* GRE
    T2*w multi-echo GRE
    FLAIR
    3D T2-weighted fluid-attenuated inversion recovery
    MP2RAGE
    magnetization-prepared 2 rapid acquisition gradient echoes
    MPRAGE
    magnetization-prepared rapid acquisition gradient echo
    SNR
    signal-to-noise ratio
    CCC
    Lin’s concordance correlation coefficient
    k
    Cohen’s kappa coefficient
    CNN
    convolutional neural network
    CLAIMS
    Cortical Lesion AI-based assessment in Multiple Sclerosis
    EDSS
    Expanded Disability Status Scale
    9-HPT
    9-Hole Peg Test
    25TW
    25-foot timed walk
    SDMT
    Symbol Digit Modalities Test
    LTPR
    lesion-wise true positive rate
    LFPR
    lesion-wise false positive rate
    DSC
    dice coefficient
    VD
    volume difference
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
    Back to top
    PreviousNext
    Posted March 03, 2022.
    Download PDF

    Supplementary Material

    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Multiple sclerosis cortical lesion detection with deep learning at ultra-high-field MRI
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Multiple sclerosis cortical lesion detection with deep learning at ultra-high-field MRI
    Francesco La Rosa, Erin S. Beck, Josefina Maranzano, Ramona-Alexandra Todea, Peter van Gelderen, Jacco A. de Zwart, Nicholas J. Luciano, Jeff H. Duyn, Jean-Philippe Thiran, Cristina Granziera, Daniel S. Reich, Pascal Sati, Meritxell Bach Cuadra
    medRxiv 2022.03.02.22271269; doi: https://doi.org/10.1101/2022.03.02.22271269
    Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
    Citation Tools
    Multiple sclerosis cortical lesion detection with deep learning at ultra-high-field MRI
    Francesco La Rosa, Erin S. Beck, Josefina Maranzano, Ramona-Alexandra Todea, Peter van Gelderen, Jacco A. de Zwart, Nicholas J. Luciano, Jeff H. Duyn, Jean-Philippe Thiran, Cristina Granziera, Daniel S. Reich, Pascal Sati, Meritxell Bach Cuadra
    medRxiv 2022.03.02.22271269; doi: https://doi.org/10.1101/2022.03.02.22271269

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Neurology
    Subject Areas
    All Articles
    • Addiction Medicine (215)
    • Allergy and Immunology (495)
    • Anesthesia (106)
    • Cardiovascular Medicine (1095)
    • Dentistry and Oral Medicine (195)
    • Dermatology (141)
    • Emergency Medicine (274)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (500)
    • Epidemiology (9764)
    • Forensic Medicine (5)
    • Gastroenterology (480)
    • Genetic and Genomic Medicine (2304)
    • Geriatric Medicine (222)
    • Health Economics (462)
    • Health Informatics (1555)
    • Health Policy (734)
    • Health Systems and Quality Improvement (603)
    • Hematology (236)
    • HIV/AIDS (503)
    • Infectious Diseases (except HIV/AIDS) (11637)
    • Intensive Care and Critical Care Medicine (616)
    • Medical Education (237)
    • Medical Ethics (67)
    • Nephrology (257)
    • Neurology (2140)
    • Nursing (134)
    • Nutrition (336)
    • Obstetrics and Gynecology (426)
    • Occupational and Environmental Health (517)
    • Oncology (1174)
    • Ophthalmology (364)
    • Orthopedics (128)
    • Otolaryngology (220)
    • Pain Medicine (145)
    • Palliative Medicine (50)
    • Pathology (310)
    • Pediatrics (694)
    • Pharmacology and Therapeutics (299)
    • Primary Care Research (266)
    • Psychiatry and Clinical Psychology (2179)
    • Public and Global Health (4653)
    • Radiology and Imaging (775)
    • Rehabilitation Medicine and Physical Therapy (457)
    • Respiratory Medicine (623)
    • Rheumatology (274)
    • Sexual and Reproductive Health (225)
    • Sports Medicine (210)
    • Surgery (250)
    • Toxicology (43)
    • Transplantation (120)
    • Urology (94)