PT - JOURNAL ARTICLE AU - Nathalie Lassau AU - Samy Ammari AU - Emilie Chouzenoux AU - Hugo Gortais AU - Paul Herent AU - Matthieu Devilder AU - Samer Soliman AU - Olivier Meyrignac AU - Marie-Pauline Talabard AU - Jean-Philippe Lamarque AU - Remy Dubois AU - Nicolas Loiseau AU - Paul Trichelair AU - Etienne Bendjebbar AU - Gabriel Garcia AU - Corinne Balleyguier AU - Mansouria Merad AU - Annabelle Stoclin AU - Simon Jegou AU - Franck Griscelli AU - Nicolas Tetelboum AU - Yingping Li AU - Sagar Verma AU - Matthieu Terris AU - Tasnim Dardouri AU - Kavya Gupta AU - Ana Neacsu AU - Frank Chemouni AU - Meriem Sefta AU - Paul Jehanno AU - Imad Bousaid AU - Yannick Boursin AU - Emmanuel Planchet AU - Mikael Azoulay AU - Jocelyn Dachary AU - Fabien Brulport AU - Adrian Gonzalez AU - Olivier Dehaene AU - Jean-Baptiste Schiratti AU - Kathryn Schutte AU - Jean-Christophe Pesquet AU - Hugues Talbot AU - Elodie Pronier AU - Gilles Wainrib AU - Thomas Clozel AU - Fabrice Barlesi AU - Marie-France Bellin AU - Michael G. B. Blum TI - AI-based multi-modal integration of clinical characteristics, lab tests and chest CTs improves COVID-19 outcome prediction of hospitalized patients AID - 10.1101/2020.05.14.20101972 DP - 2020 Jan 01 TA - medRxiv PG - 2020.05.14.20101972 4099 - http://medrxiv.org/content/early/2020/05/19/2020.05.14.20101972.short 4100 - http://medrxiv.org/content/early/2020/05/19/2020.05.14.20101972.full AB - With 15% of severe cases among hospitalized patients1, the SARS-COV-2 pandemic has put tremendous pressure on Intensive Care Units, and made the identification of early predictors of future severity a public health priority. We collected clinical and biological data, as well as CT scan images and radiology reports from 1,003 coronavirus-infected patients from two French hospitals. Radiologists’ manual CT annotations were also available. We first identified 11 clinical variables and 3 types of radiologist-reported features significantly associated with prognosis. Next, focusing on the CT images, we trained deep learning models to automatically segment the scans and reproduce radiologists’ annotations. We also built CT image-based deep learning models that predicted future severity better than models based on the radiologists’ scan reports. Finally, we showed that including CT scan features alongside the clinical and biological data yielded more accurate predictions than using clinical and biological data alone. These findings show that CT scans provide insightful early predictors of future severity.Competing Interest StatementThe authors declare the following competing interests: Employment: Michael Blum, Paul Herent, Rémy Dubois, Nicolas Loiseau, Paul Trichelair, Etienne Bendjebbar, Simon Jégou, Meriem Sefta, Paul Jehanno, Fabien Brulport, Olivier Dehaene, Jean-Baptiste Schiratti, Kathryn Schutte, Elodie Pronier, Jocelyn Dachary, Adrian Gonzalez, employed by Owkin Co-founders of Owkin Inc : Thomas Clozel, Gilles Wainrib. Funding StatementOwkin employees are paid by Owkin, Inc.Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesData are not publicly available and are securely stored on a certified server.