Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

AI-based multi-modal integration of clinical characteristics, lab tests and chest CTs improves COVID-19 outcome prediction of hospitalized patients

Nathalie Lassau, Samy Ammari, Emilie Chouzenoux, Hugo Gortais, Paul Herent, Matthieu Devilder, Samer Soliman, Olivier Meyrignac, Marie-Pauline Talabard, Jean-Philippe Lamarque, Remy Dubois, Nicolas Loiseau, Paul Trichelair, Etienne Bendjebbar, Gabriel Garcia, Corinne Balleyguier, Mansouria Merad, Annabelle Stoclin, Simon Jegou, Franck Griscelli, Nicolas Tetelboum, Yingping Li, Sagar Verma, Matthieu Terris, Tasnim Dardouri, Kavya Gupta, Ana Neacsu, Frank Chemouni, Meriem Sefta, Paul Jehanno, Imad Bousaid, Yannick Boursin, Emmanuel Planchet, Mikael Azoulay, Jocelyn Dachary, Fabien Brulport, Adrian Gonzalez, Olivier Dehaene, Jean-Baptiste Schiratti, Kathryn Schutte, Jean-Christophe Pesquet, Hugues Talbot, Elodie Pronier, Gilles Wainrib, Thomas Clozel, Fabrice Barlesi, Marie-France Bellin, Michael G. B. Blum
doi: https://doi.org/10.1101/2020.05.14.20101972
Nathalie Lassau
1Imaging Department Gustave Roussy. Université Paris Saclay, Villejuif,F-94805
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Samy Ammari
1Imaging Department Gustave Roussy. Université Paris Saclay, Villejuif,F-94805
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emilie Chouzenoux
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hugo Gortais
4Radiology Department, Hôpital de Bicêtre – AP-HP, Université Paris Saclay, Le Kremlin-Bicêtre, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul Herent
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthieu Devilder
4Radiology Department, Hôpital de Bicêtre – AP-HP, Université Paris Saclay, Le Kremlin-Bicêtre, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Samer Soliman
4Radiology Department, Hôpital de Bicêtre – AP-HP, Université Paris Saclay, Le Kremlin-Bicêtre, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Olivier Meyrignac
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marie-Pauline Talabard
4Radiology Department, Hôpital de Bicêtre – AP-HP, Université Paris Saclay, Le Kremlin-Bicêtre, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean-Philippe Lamarque
1Imaging Department Gustave Roussy. Université Paris Saclay, Villejuif,F-94805
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Remy Dubois
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicolas Loiseau
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul Trichelair
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Etienne Bendjebbar
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gabriel Garcia
1Imaging Department Gustave Roussy. Université Paris Saclay, Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Corinne Balleyguier
1Imaging Department Gustave Roussy. Université Paris Saclay, Villejuif,F-94805
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mansouria Merad
6Département d’Oncologie Médicale, Gustave Roussy,Université Paris-Saclay, Villejuif, F-94805, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Annabelle Stoclin
7Département de Soins Intensifs, Gustave Roussy, Université Paris-Saclay, Villejuif, F-94805, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Simon Jegou
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Franck Griscelli
8Département de Biologie, Gustave Roussy, Université Paris-Saclay, Villejuif, F-94805, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicolas Tetelboum
1Imaging Department Gustave Roussy. Université Paris Saclay, Villejuif,F-94805
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yingping Li
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sagar Verma
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthieu Terris
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tasnim Dardouri
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kavya Gupta
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ana Neacsu
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frank Chemouni
7Département de Soins Intensifs, Gustave Roussy, Université Paris-Saclay, Villejuif, F-94805, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Meriem Sefta
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul Jehanno
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Imad Bousaid
9Direction de la Transformation Numérique et des Systèmes d’Information, Gustave Roussy, 94800 Villejuif, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yannick Boursin
9Direction de la Transformation Numérique et des Systèmes d’Information, Gustave Roussy, 94800 Villejuif, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emmanuel Planchet
9Direction de la Transformation Numérique et des Systèmes d’Information, Gustave Roussy, 94800 Villejuif, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mikael Azoulay
9Direction de la Transformation Numérique et des Systèmes d’Information, Gustave Roussy, 94800 Villejuif, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jocelyn Dachary
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fabien Brulport
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adrian Gonzalez
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Olivier Dehaene
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean-Baptiste Schiratti
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kathryn Schutte
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean-Christophe Pesquet
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hugues Talbot
3Centre de Vision Numérique, Université Paris-Saclay, CentraleSupélec, Inria, 91190 Gif-sur-Yvette, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elodie Pronier
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gilles Wainrib
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas Clozel
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fabrice Barlesi
6Département d’Oncologie Médicale, Gustave Roussy,Université Paris-Saclay, Villejuif, F-94805, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marie-France Bellin
2Biomaps. UMR1281 INSERM.CEA.CNRS.Université Paris-Saclay. Villejuif,F-94805
4Radiology Department, Hôpital de Bicêtre – AP-HP, Université Paris Saclay, Le Kremlin-Bicêtre, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael G. B. Blum
5Owkin Lab, Owkin, Inc. New York, NY USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: michael.blum@owkin.com
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

With 15% of severe cases among hospitalized patients1, the SARS-COV-2 pandemic has put tremendous pressure on Intensive Care Units, and made the identification of early predictors of future severity a public health priority. We collected clinical and biological data, as well as CT scan images and radiology reports from 1,003 coronavirus-infected patients from two French hospitals. Radiologists’ manual CT annotations were also available. We first identified 11 clinical variables and 3 types of radiologist-reported features significantly associated with prognosis. Next, focusing on the CT images, we trained deep learning models to automatically segment the scans and reproduce radiologists’ annotations. We also built CT image-based deep learning models that predicted future severity better than models based on the radiologists’ scan reports. Finally, we showed that including CT scan features alongside the clinical and biological data yielded more accurate predictions than using clinical and biological data alone. These findings show that CT scans provide insightful early predictors of future severity.

Competing Interest Statement

The authors declare the following competing interests: Employment: Michael Blum, Paul Herent, Rémy Dubois, Nicolas Loiseau, Paul Trichelair, Etienne Bendjebbar, Simon Jégou, Meriem Sefta, Paul Jehanno, Fabien Brulport, Olivier Dehaene, Jean-Baptiste Schiratti, Kathryn Schutte, Elodie Pronier, Jocelyn Dachary, Adrian Gonzalez, employed by Owkin Co-founders of Owkin Inc : Thomas Clozel, Gilles Wainrib.

Funding Statement

Owkin employees are paid by Owkin, Inc.

Author Declarations

All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Data are not publicly available and are securely stored on a certified server.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted May 19, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
AI-based multi-modal integration of clinical characteristics, lab tests and chest CTs improves COVID-19 outcome prediction of hospitalized patients
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
AI-based multi-modal integration of clinical characteristics, lab tests and chest CTs improves COVID-19 outcome prediction of hospitalized patients
Nathalie Lassau, Samy Ammari, Emilie Chouzenoux, Hugo Gortais, Paul Herent, Matthieu Devilder, Samer Soliman, Olivier Meyrignac, Marie-Pauline Talabard, Jean-Philippe Lamarque, Remy Dubois, Nicolas Loiseau, Paul Trichelair, Etienne Bendjebbar, Gabriel Garcia, Corinne Balleyguier, Mansouria Merad, Annabelle Stoclin, Simon Jegou, Franck Griscelli, Nicolas Tetelboum, Yingping Li, Sagar Verma, Matthieu Terris, Tasnim Dardouri, Kavya Gupta, Ana Neacsu, Frank Chemouni, Meriem Sefta, Paul Jehanno, Imad Bousaid, Yannick Boursin, Emmanuel Planchet, Mikael Azoulay, Jocelyn Dachary, Fabien Brulport, Adrian Gonzalez, Olivier Dehaene, Jean-Baptiste Schiratti, Kathryn Schutte, Jean-Christophe Pesquet, Hugues Talbot, Elodie Pronier, Gilles Wainrib, Thomas Clozel, Fabrice Barlesi, Marie-France Bellin, Michael G. B. Blum
medRxiv 2020.05.14.20101972; doi: https://doi.org/10.1101/2020.05.14.20101972
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
AI-based multi-modal integration of clinical characteristics, lab tests and chest CTs improves COVID-19 outcome prediction of hospitalized patients
Nathalie Lassau, Samy Ammari, Emilie Chouzenoux, Hugo Gortais, Paul Herent, Matthieu Devilder, Samer Soliman, Olivier Meyrignac, Marie-Pauline Talabard, Jean-Philippe Lamarque, Remy Dubois, Nicolas Loiseau, Paul Trichelair, Etienne Bendjebbar, Gabriel Garcia, Corinne Balleyguier, Mansouria Merad, Annabelle Stoclin, Simon Jegou, Franck Griscelli, Nicolas Tetelboum, Yingping Li, Sagar Verma, Matthieu Terris, Tasnim Dardouri, Kavya Gupta, Ana Neacsu, Frank Chemouni, Meriem Sefta, Paul Jehanno, Imad Bousaid, Yannick Boursin, Emmanuel Planchet, Mikael Azoulay, Jocelyn Dachary, Fabien Brulport, Adrian Gonzalez, Olivier Dehaene, Jean-Baptiste Schiratti, Kathryn Schutte, Jean-Christophe Pesquet, Hugues Talbot, Elodie Pronier, Gilles Wainrib, Thomas Clozel, Fabrice Barlesi, Marie-France Bellin, Michael G. B. Blum
medRxiv 2020.05.14.20101972; doi: https://doi.org/10.1101/2020.05.14.20101972

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (215)
  • Allergy and Immunology (495)
  • Anesthesia (106)
  • Cardiovascular Medicine (1093)
  • Dentistry and Oral Medicine (195)
  • Dermatology (141)
  • Emergency Medicine (274)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (499)
  • Epidemiology (9757)
  • Forensic Medicine (5)
  • Gastroenterology (480)
  • Genetic and Genomic Medicine (2303)
  • Geriatric Medicine (222)
  • Health Economics (462)
  • Health Informatics (1553)
  • Health Policy (732)
  • Health Systems and Quality Improvement (602)
  • Hematology (236)
  • HIV/AIDS (501)
  • Infectious Diseases (except HIV/AIDS) (11631)
  • Intensive Care and Critical Care Medicine (616)
  • Medical Education (236)
  • Medical Ethics (67)
  • Nephrology (256)
  • Neurology (2139)
  • Nursing (134)
  • Nutrition (335)
  • Obstetrics and Gynecology (426)
  • Occupational and Environmental Health (517)
  • Oncology (1172)
  • Ophthalmology (363)
  • Orthopedics (128)
  • Otolaryngology (220)
  • Pain Medicine (145)
  • Palliative Medicine (50)
  • Pathology (309)
  • Pediatrics (694)
  • Pharmacology and Therapeutics (298)
  • Primary Care Research (265)
  • Psychiatry and Clinical Psychology (2172)
  • Public and Global Health (4645)
  • Radiology and Imaging (775)
  • Rehabilitation Medicine and Physical Therapy (455)
  • Respiratory Medicine (623)
  • Rheumatology (274)
  • Sexual and Reproductive Health (225)
  • Sports Medicine (208)
  • Surgery (250)
  • Toxicology (43)
  • Transplantation (120)
  • Urology (94)