Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Early prediction of mortality risk among severe COVID-19 patients using machine learning

Chuanyu Hu, Zhenqiu Liu, Yanfeng Jiang, Xin Zhang, Oumin Shi, Kelin Xu, Chen Suo, Qin Wang, Yujing Song, Kangkang Yu, Xianhua Mao, Xuefu Wu, Mingshan Wu, Tingting Shi, Wei Jiang, Lina Mu, Damien C Tully, Lei Xu, Li Jin, Shusheng Li, Xuejin Tao, Tiejun Zhang, Xingdong Chen
doi: https://doi.org/10.1101/2020.04.13.20064329
Chuanyu Hu
1Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhenqiu Liu
2State Key Laboratory of Genetic Engineering, Human Phenome Institute, and School of Life Sciences, Fudan University, Shanghai, 200438, China
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yanfeng Jiang
2State Key Laboratory of Genetic Engineering, Human Phenome Institute, and School of Life Sciences, Fudan University, Shanghai, 200438, China
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Xin Zhang
4Key Laboratory of Public Health Safety, Fudan University, Ministry of Education, China and Department of Epidemiology, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Oumin Shi
5Health Science Center, Shenzhen Second People’s Hospital. The First Affiliated Hospital of Shenzhen University, Shenzhen, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kelin Xu
7Department of Biostatistics, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chen Suo
4Key Laboratory of Public Health Safety, Fudan University, Ministry of Education, China and Department of Epidemiology, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Qin Wang
1Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yujing Song
1Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kangkang Yu
6Department of Infectious Diseases, Huashan Hospital, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Xianhua Mao
2State Key Laboratory of Genetic Engineering, Human Phenome Institute, and School of Life Sciences, Fudan University, Shanghai, 200438, China
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Xuefu Wu
4Key Laboratory of Public Health Safety, Fudan University, Ministry of Education, China and Department of Epidemiology, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mingshan Wu
4Key Laboratory of Public Health Safety, Fudan University, Ministry of Education, China and Department of Epidemiology, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tingting Shi
4Key Laboratory of Public Health Safety, Fudan University, Ministry of Education, China and Department of Epidemiology, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wei Jiang
2State Key Laboratory of Genetic Engineering, Human Phenome Institute, and School of Life Sciences, Fudan University, Shanghai, 200438, China
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lina Mu
8Department of Epidemiology and Environmental Health, School of Public Health and Health Professions, University at Buffalo, State University of New York, Buffalo, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Damien C Tully
9Department of Infectious Disease Epidemiology, London School of Hygiene & Tropical Medicine, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lei Xu
10Emergency Medicine Department of the Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Li Jin
2State Key Laboratory of Genetic Engineering, Human Phenome Institute, and School of Life Sciences, Fudan University, Shanghai, 200438, China
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shusheng Li
1Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: shushengli16@sina.com taoxuejin@aliyun.com tjzhang@shmu.edu.cn xingdongchen@fudan.edu.cn
Xuejin Tao
1Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: shushengli16@sina.com taoxuejin@aliyun.com tjzhang@shmu.edu.cn xingdongchen@fudan.edu.cn
Tiejun Zhang
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
4Key Laboratory of Public Health Safety, Fudan University, Ministry of Education, China and Department of Epidemiology, School of Public Health, Fudan University, Shanghai, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: shushengli16@sina.com taoxuejin@aliyun.com tjzhang@shmu.edu.cn xingdongchen@fudan.edu.cn
Xingdong Chen
2State Key Laboratory of Genetic Engineering, Human Phenome Institute, and School of Life Sciences, Fudan University, Shanghai, 200438, China
3Fudan University Taizhou Institute of Health Sciences, Taizhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: shushengli16@sina.com taoxuejin@aliyun.com tjzhang@shmu.edu.cn xingdongchen@fudan.edu.cn
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection has been spreading globally. The number of deaths has increased with the increase in the number of infected patients. We aimed to develop a clinical model to predict the outcome of severe COVID-19 patients early.

Methods Epidemiological, clinical, and first laboratory findings after admission of 183 severe COVID-19 patients (115 survivors and 68 nonsurvivors) from the Sino-French New City Branch of Tongji Hospital were used to develop the predictive models. Five machine learning approaches (logistic regression, partial least squares regression, elastic net, random forest, and bagged flexible discriminant analysis) were used to select the features and predict the patients’ outcomes. The area under the receiver operating characteristic curve (AUROC) was applied to compare the models’ performance. Sixty-four severe COVID-19 patients from the Optical Valley Branch of Tongji Hospital were used to externally validate the final predictive model.

Results The baseline characteristics and laboratory tests were significantly different between the survivors and nonsurvivors. Four variables (age, high-sensitivity C-reactive protein level, lymphocyte count, and d-dimer level) were selected by all five models. Given the similar performance among the models, the logistic regression model was selected as the final predictive model because of its simplicity and interpretability. The AUROCs of the derivation and external validation sets were 0.895 and 0.881, respectively. The sensitivity and specificity were 0.892 and 0.687 for the derivation set and 0.839 and 0.794 for the validation set, respectively, when using a probability of death of 50% as the cutoff. The individual risk score based on the four selected variables and the corresponding probability of death can serve as indexes to assess the mortality risk of COVID-19 patients. The predictive model is freely available at https://phenomics.fudan.edu.cn/risk_scores/.

Conclusions Age, high-sensitivity C-reactive protein level, lymphocyte count, and d-dimer level of COVID-19 patients at admission are informative for the patients’ outcomes.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was supported by the National Natural Science Foundation of China (grant number: 91846302, 81772170); the National Key Research and Development Program of China (grant numbers: 2017YFC0907000, 2017YFC0907500, 2019YFC1315804); Key Basic Research Grants from the Science and Technology Commission of Shanghai Municipality (grant number: 16JC1400500); and Shanghai Municipal Science and Technology Major Project (grant number: 2017SHZDZX01). Natural Science Foundation of Hubei (grant no. 2019CFB657).

Author Declarations

All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data were collected from medical records in Tongji Hospital, Wuhan, China.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted April 19, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Early prediction of mortality risk among severe COVID-19 patients using machine learning
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Early prediction of mortality risk among severe COVID-19 patients using machine learning
Chuanyu Hu, Zhenqiu Liu, Yanfeng Jiang, Xin Zhang, Oumin Shi, Kelin Xu, Chen Suo, Qin Wang, Yujing Song, Kangkang Yu, Xianhua Mao, Xuefu Wu, Mingshan Wu, Tingting Shi, Wei Jiang, Lina Mu, Damien C Tully, Lei Xu, Li Jin, Shusheng Li, Xuejin Tao, Tiejun Zhang, Xingdong Chen
medRxiv 2020.04.13.20064329; doi: https://doi.org/10.1101/2020.04.13.20064329
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Early prediction of mortality risk among severe COVID-19 patients using machine learning
Chuanyu Hu, Zhenqiu Liu, Yanfeng Jiang, Xin Zhang, Oumin Shi, Kelin Xu, Chen Suo, Qin Wang, Yujing Song, Kangkang Yu, Xianhua Mao, Xuefu Wu, Mingshan Wu, Tingting Shi, Wei Jiang, Lina Mu, Damien C Tully, Lei Xu, Li Jin, Shusheng Li, Xuejin Tao, Tiejun Zhang, Xingdong Chen
medRxiv 2020.04.13.20064329; doi: https://doi.org/10.1101/2020.04.13.20064329

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (164)
  • Allergy and Immunology (417)
  • Anesthesia (93)
  • Cardiovascular Medicine (867)
  • Dentistry and Oral Medicine (159)
  • Dermatology (98)
  • Emergency Medicine (251)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (398)
  • Epidemiology (8597)
  • Forensic Medicine (4)
  • Gastroenterology (391)
  • Genetic and Genomic Medicine (1775)
  • Geriatric Medicine (170)
  • Health Economics (376)
  • Health Informatics (1252)
  • Health Policy (625)
  • Health Systems and Quality Improvement (472)
  • Hematology (198)
  • HIV/AIDS (380)
  • Infectious Diseases (except HIV/AIDS) (10354)
  • Intensive Care and Critical Care Medicine (554)
  • Medical Education (193)
  • Medical Ethics (51)
  • Nephrology (214)
  • Neurology (1692)
  • Nursing (97)
  • Nutrition (252)
  • Obstetrics and Gynecology (330)
  • Occupational and Environmental Health (451)
  • Oncology (934)
  • Ophthalmology (265)
  • Orthopedics (104)
  • Otolaryngology (172)
  • Pain Medicine (115)
  • Palliative Medicine (40)
  • Pathology (256)
  • Pediatrics (541)
  • Pharmacology and Therapeutics (257)
  • Primary Care Research (210)
  • Psychiatry and Clinical Psychology (1788)
  • Public and Global Health (3877)
  • Radiology and Imaging (629)
  • Rehabilitation Medicine and Physical Therapy (324)
  • Respiratory Medicine (525)
  • Rheumatology (208)
  • Sexual and Reproductive Health (171)
  • Sports Medicine (159)
  • Surgery (191)
  • Toxicology (36)
  • Transplantation (101)
  • Urology (76)