Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Predicting mortality of individual COVID-19 patients: A multicenter Dutch cohort

View ORCID ProfileMaarten C. Ottenhoff, View ORCID ProfileLucas L. Ramos, Wouter Potters, Marcus L.F. Janssen, Deborah Hubers, Dan Piña-Fuentes, Rajat Thomas, View ORCID ProfileIwan C.C. van der Horst, Christian Herff, Pieter Kubben, Paul W.G. Elbers, Henk A. Marquering, Max Welling, Shi Hu, Suat Simsek, Martijn D. de Kruif, Tom Dormans, Lucas M. Fleuren, Michiel Schinkel, Peter G. Noordzij, Joop P. van den Bergh, Caroline E. Wyers, David T. B. Buis, Joost Wiersinga, Ella H.C. van den Hout, Auke C. Reidinga, Daisy Rusch, Kim C.E. Sigaloff, Renée Douma, Lianne de Haan, Egill A. Fridgeirsson, Niels C. Gritters van den Oever, Roger J.M.W. Rennenberg, Guido A. van Wingen, Marcel J.H. Aries, Martijn Beudel
doi: https://doi.org/10.1101/2020.10.10.20210591
Maarten C. Ottenhoff
1Department of Neurosurgery, School for Mental Health and Neuroscience, Maastricht University, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maarten C. Ottenhoff
  • For correspondence: m.ottenhoff@maastrichtuniversity.nl
Lucas L. Ramos
2Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, Amsterdam, the Netherlands
3Department of Epidemiology & Data science, Amsterdam University Medical Centers, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lucas L. Ramos
Wouter Potters
4Department of Neurology, Amsterdam Neuroscience Institute, Amsterdam University Medical Center, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marcus L.F. Janssen
5Department of Clinical Neurophysiology, Maastricht University Medical Center, School for Mental Health and Neuroscience
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Deborah Hubers
6Department of Intensive Care, Maastricht University Medical Center, Maastricht, the Netherlands
7Technical University Twente, Enschede, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dan Piña-Fuentes
4Department of Neurology, Amsterdam Neuroscience Institute, Amsterdam University Medical Center, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rajat Thomas
8Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Iwan C.C. van der Horst
6Department of Intensive Care, Maastricht University Medical Center, Maastricht, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Iwan C.C. van der Horst
Christian Herff
1Department of Neurosurgery, School for Mental Health and Neuroscience, Maastricht University, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pieter Kubben
9Department of Neurosurgery, Maastricht University Medical Center, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul W.G. Elbers
10EDIC, Department of Intensive Care Medicine, Research VUmc Intensive Care (REVIVE), Amsterdam Medical Data science (AMDS), Amsterdam Cardiovascular Sciences (ACS), Amsterdam Infection and Immunity Institute (AI&II), Amsterdam UMC, location VUmc, VU Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Henk A. Marquering
2Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, Amsterdam, the Netherlands
11Department of Radiology & Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Max Welling
12Informatics Institute, University of Amsterdam, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shi Hu
12Informatics Institute, University of Amsterdam, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Suat Simsek
13Department of Internal Medicine, Northwest Clinics, Alkmaar, the Netherlands
14Department of Internal Medicine & Endocrinology, Amsterdam University Medical Center, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martijn D. de Kruif
15Department of Pulmonary Medicine, Zuyderland Medical Center, Heerlen, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tom Dormans
16Department of Intensive Care, Zuyderland Medical Center, Heerlen, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lucas M. Fleuren
18Department of Anesthesiology and Intensive Care, St Antonius Hospital, Nieuwegein, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michiel Schinkel
17Center for Experimental and Molecular Medicine (C.E.M.M.), Amsterdam UMC, location Academic Medical Center, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter G. Noordzij
18Department of Anesthesiology and Intensive Care, St Antonius Hospital, Nieuwegein, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joop P. van den Bergh
19Department of Internal Medicine, VieCuri Medical Centre, Venlo, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caroline E. Wyers
19Department of Internal Medicine, VieCuri Medical Centre, Venlo, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David T. B. Buis
20Department of Internal Medicine, Amsterdam institute for Infection and Immunity, Amsterdam University Medical Center, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joost Wiersinga
21Department of Internal Medicine, Division of Infectious Diseases, Amsterdam Institute for Infection and Immunity, Amsterdam UMC, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ella H.C. van den Hout
13Department of Internal Medicine, Northwest Clinics, Alkmaar, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Auke C. Reidinga
22Department of Intensive Care, Martiniziekenhuis, Groningen, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daisy Rusch
23Research, Martiniziekenhuis, Groningen, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kim C.E. Sigaloff
24Department of Internal Medicine, Division of Infectious Diseases, Amsterdam Institute for Infection and Immunity, Amsterdam UMC, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Renée Douma
25Department of Internal Medicine, Flevoziekenhuis, Almere, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lianne de Haan
25Department of Internal Medicine, Flevoziekenhuis, Almere, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Egill A. Fridgeirsson
8Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Niels C. Gritters van den Oever
26Department of Intensive Care, Treant Zorggroep, Emmen, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Roger J.M.W. Rennenberg
27Department of Internal Medicine, Maastricht University, Maastricht University Medical Center, Maastricht, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Guido A. van Wingen
8Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marcel J.H. Aries
6Department of Intensive Care, Maastricht University Medical Center, Maastricht, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martijn Beudel
4Department of Neurology, Amsterdam Neuroscience Institute, Amsterdam University Medical Center, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Objective Develop and validate models that predict mortality of SARS-CoV-2 infected patients admitted to the hospital.

Design Retrospective cohort study

Setting A multicenter cohort across ten Dutch hospitals including patients from February 27 to June 8 2020.

Participants SARS-CoV-2 positive patients (age ≥ 18) admitted to the hospital.

Main Outcome Measures 21-day mortality evaluated by the area under the receiver operatory curve (AUC), sensitivity, specificity, positive predictive value and negative predictive value. The predictive value of age was explored by comparison with age-based rules used in practice and by excluding age from analysis.

Results 2273 patients were included, of whom 516 had died or discharged to palliative care within 21 days after admission. Five feature sets, including premorbid, clinical presentation and laboratory & radiology values, were derived from 80 features. Additionally, an ANOVA-based data-driven feature selection selected the ten features with the highest F-values: age, number of home medications, urea nitrogen, lactate dehydrogenase, albumin, oxygen saturation (%), oxygen saturation is measured on room air, oxygen saturation is measured on oxygen therapy, blood gas pH and history of chronic cardiac disease. A linear logistic regression (LR) and non-linear tree-based gradient boosting (XGB) algorithm fitted the data with an AUC of 0.81 (95% confidence interval 0.77 to 0.85) and 0.82 (0.79 to 0.85), respectively, using the ten selected features. Both models outperformed age-based decision rules used in practice (AUC of 0.69, 0.65 to 0.74 for age > 70). Furthermore, performance remained stable when excluding age as predictor (AUC of 0.78, 0.75 to 0.81)

Conclusion Both models showed excellent performance and had better test characteristics than age-based decision rules, using ten admission features readily available in Dutch hospitals. The models hold promise to aid decision making during a hospital bed shortage.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

No funding to declare

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Amsterdam University Medical Centers (Amsterdam UMC; 20.131) Maastricht University Medical Center (MUMC; 2020-1323)

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

DATA SHARING Not all patients provided active informed consent, and therefore data cannot be shared. The code used in this study is made publicly available and can be found at

https://doi.org/10.5281/zenodo.4077342

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted October 13, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Predicting mortality of individual COVID-19 patients: A multicenter Dutch cohort
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Predicting mortality of individual COVID-19 patients: A multicenter Dutch cohort
Maarten C. Ottenhoff, Lucas L. Ramos, Wouter Potters, Marcus L.F. Janssen, Deborah Hubers, Dan Piña-Fuentes, Rajat Thomas, Iwan C.C. van der Horst, Christian Herff, Pieter Kubben, Paul W.G. Elbers, Henk A. Marquering, Max Welling, Shi Hu, Suat Simsek, Martijn D. de Kruif, Tom Dormans, Lucas M. Fleuren, Michiel Schinkel, Peter G. Noordzij, Joop P. van den Bergh, Caroline E. Wyers, David T. B. Buis, Joost Wiersinga, Ella H.C. van den Hout, Auke C. Reidinga, Daisy Rusch, Kim C.E. Sigaloff, Renée Douma, Lianne de Haan, Egill A. Fridgeirsson, Niels C. Gritters van den Oever, Roger J.M.W. Rennenberg, Guido A. van Wingen, Marcel J.H. Aries, Martijn Beudel
medRxiv 2020.10.10.20210591; doi: https://doi.org/10.1101/2020.10.10.20210591
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
Predicting mortality of individual COVID-19 patients: A multicenter Dutch cohort
Maarten C. Ottenhoff, Lucas L. Ramos, Wouter Potters, Marcus L.F. Janssen, Deborah Hubers, Dan Piña-Fuentes, Rajat Thomas, Iwan C.C. van der Horst, Christian Herff, Pieter Kubben, Paul W.G. Elbers, Henk A. Marquering, Max Welling, Shi Hu, Suat Simsek, Martijn D. de Kruif, Tom Dormans, Lucas M. Fleuren, Michiel Schinkel, Peter G. Noordzij, Joop P. van den Bergh, Caroline E. Wyers, David T. B. Buis, Joost Wiersinga, Ella H.C. van den Hout, Auke C. Reidinga, Daisy Rusch, Kim C.E. Sigaloff, Renée Douma, Lianne de Haan, Egill A. Fridgeirsson, Niels C. Gritters van den Oever, Roger J.M.W. Rennenberg, Guido A. van Wingen, Marcel J.H. Aries, Martijn Beudel
medRxiv 2020.10.10.20210591; doi: https://doi.org/10.1101/2020.10.10.20210591

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (62)
  • Allergy and Immunology (142)
  • Anesthesia (46)
  • Cardiovascular Medicine (415)
  • Dentistry and Oral Medicine (70)
  • Dermatology (48)
  • Emergency Medicine (144)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (171)
  • Epidemiology (4861)
  • Forensic Medicine (3)
  • Gastroenterology (183)
  • Genetic and Genomic Medicine (676)
  • Geriatric Medicine (70)
  • Health Economics (192)
  • Health Informatics (630)
  • Health Policy (321)
  • Health Systems and Quality Improvement (206)
  • Hematology (85)
  • HIV/AIDS (156)
  • Infectious Diseases (except HIV/AIDS) (5343)
  • Intensive Care and Critical Care Medicine (331)
  • Medical Education (93)
  • Medical Ethics (24)
  • Nephrology (75)
  • Neurology (686)
  • Nursing (42)
  • Nutrition (115)
  • Obstetrics and Gynecology (126)
  • Occupational and Environmental Health (208)
  • Oncology (440)
  • Ophthalmology (140)
  • Orthopedics (36)
  • Otolaryngology (90)
  • Pain Medicine (35)
  • Palliative Medicine (16)
  • Pathology (129)
  • Pediatrics (194)
  • Pharmacology and Therapeutics (131)
  • Primary Care Research (84)
  • Psychiatry and Clinical Psychology (781)
  • Public and Global Health (1817)
  • Radiology and Imaging (325)
  • Rehabilitation Medicine and Physical Therapy (138)
  • Respiratory Medicine (255)
  • Rheumatology (86)
  • Sexual and Reproductive Health (69)
  • Sports Medicine (62)
  • Surgery (100)
  • Toxicology (23)
  • Transplantation (29)
  • Urology (37)