Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

COVID Outcome Prediction in the Emergency Department (COPE): Development and validation of a model for predicting death and need for intensive care in COVID-19 patients

David van Klaveren, Alexandros Rekkas, Jelmer Alsma, Rob JCG Verdonschot, Dick TJJ Koning, Marlijn JA Kamps, Tom Dormans, Robert Stassen, Sebastiaan Weijer, Klaas-Sierk Arnold, Benjamin Tomlow, Hilde RH de Geus, Rozemarijn L van Bruchem-Visser, Jelle R Miedema, Annelies Verbon, Els van Nood, David M Kent, Stephanie CE Schuit, Hester Lingsma
doi: https://doi.org/10.1101/2020.12.30.20249023
David van Klaveren
1Department of Public Health, Erasmus University Medical Center Rotterdam, The Netherlands
2Predictive Analytics and Comparative Effectiveness Center, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: d.vanklaveren@erasmusmc.nl
Alexandros Rekkas
3Department of Medical Informatics, Erasmus University Medical Center Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jelmer Alsma
4Department of Internal Medicine, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rob JCG Verdonschot
5Emergency Department, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dick TJJ Koning
6Department of Intensive Care, Catharina Hospital, Eindhoven, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marlijn JA Kamps
6Department of Intensive Care, Catharina Hospital, Eindhoven, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tom Dormans
7Department of Intensive Care, Zuyderland Medical Center, Heerlen, Limburg, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Stassen
8Department of Traumatology, Maastricht University Medical Centre, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sebastiaan Weijer
9Department of Internal Medicine, Antonius Hospital, Sneek, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Klaas-Sierk Arnold
10Department of Intensive Care, Antonius Hospital, Sneek, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin Tomlow
11Department of Pulmonary Medicine, Isala Clinics, Zwolle, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hilde RH de Geus
12Department of Intensive Care, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rozemarijn L van Bruchem-Visser
4Department of Internal Medicine, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jelle R Miedema
13Department of Pulmonary Medicine, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Annelies Verbon
14Department of Medical Microbiology and Infectious Diseases, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Els van Nood
4Department of Internal Medicine, Erasmus University Medical Center, Rotterdam, The Netherlands
14Department of Medical Microbiology and Infectious Diseases, Erasmus University Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David M Kent
2Predictive Analytics and Comparative Effectiveness Center, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephanie CE Schuit
15University Medical Center Groningen, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hester Lingsma
1Department of Public Health, Erasmus University Medical Center Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background and aim COVID-19 is putting extraordinary pressure on emergency departments (EDs). To support decision making in the ED, we aimed to develop a simple and valid model for predicting mortality and need for intensive care unit (ICU) admission in suspected COVID-19 patients.

Methods For model development, we retrospectively collected data of patients who were admitted to 4 large Dutch hospitals with suspected COVID-19 between March and August 2020 (first wave of the pandemic). Based on prior literature we considered quickly and objectively obtainable patient characteristics, vital parameters and blood test values as predictors. Logistic regression analyses with post-hoc uniform shrinkage was used to obtain predicted probabilities of in-hospital death and of the need for ICU admission, both within 28 days after hospital admission. We assessed model performance (Area Under the ROC curve (AUC); calibration plots) with temporal validation in patients who presented between September and December 2020 (second wave). We used multiple imputation to account for missing values.

Results The development data included 5,831 patients, of whom 629 (10.8%) died and 5,070 (86.9%) were discharged within 28 days after admission. ICU admission was fully recorded for 2,633 first wave patients in 2 hospitals, with 214 (8%) ICU admissions within 28 days. A simple model – COVID Outcome Prediction in the Emergency Department (COPE) – with age, respiratory rate, C-reactive protein, lactic dehydrogenase, albumin and urea captured most of the ability to predict death. COPE was well-calibrated and showed good discrimination in 3,252 second wave patients (AUC in 4 hospitals: 0.82 [0.78; 0.86]; 0.82 [0.74; 0.90]; 0.79 [0.70; 0.88]; 0.83 [0.79; 0.86]). COPE was also able to identify patients at high risk of needing IC in 706 second wave patients with complete information on ICU admission (AUC: 0.84 [0.78; 0.90]; 0.81 [0.66; 0.95]). The models are implemented in web-based and mobile applications.

Conclusion COPE is a simple tool that is well able to predict mortality and need for ICU admission for patients who present to the ED with suspected COVID-19 and may help patients and doctors in decision making.

What is already known on this topic

  • Prediction models have the potential to support decision making about hospital admission of patients presenting to the emergency department with suspected COVID-19

  • Most currently available models that were independently assessed contain a high risk of bias

  • Promising models were developed in different patient selections and included predictors that are not quickly and objective obtainable in emergency departments

What this study adds

  • A simple and objective tool (“COPE”) is well able to predict mortality and need for ICU admission for patients who present to the ED with suspected COVID-19

  • COPE may support ED physicians to identify high-risk patients – i.e. those at high risk of deterioration and/or death – requiring treatment in the ICU, intermediate-risk patients requiring admission to the clinical ward, and low-risk patients who can potentially be sent home

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was supported by ZonMw (project number 10430 01 201 0019: Clinical prediction models for COVID-19: development, international validation and use) and the Patient-Centered Outcomes Research Institute (PCORI grant number ME-1606-35555: How Well Do Clinical Prediction Models (CPMs) Validate? A Large-Scale Evaluation of Cardiovascular Clinical Prediction Models).

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The Daily Board of the Medical Ethics Committee Erasmus MC of Rotterdam, The Netherlands, has approved the research proposal (MEC-2020-0297).

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

According to data transfer agreements the data is not publicly available.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
Back to top
PreviousNext
Posted February 08, 2021.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
COVID Outcome Prediction in the Emergency Department (COPE): Development and validation of a model for predicting death and need for intensive care in COVID-19 patients
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
COVID Outcome Prediction in the Emergency Department (COPE): Development and validation of a model for predicting death and need for intensive care in COVID-19 patients
David van Klaveren, Alexandros Rekkas, Jelmer Alsma, Rob JCG Verdonschot, Dick TJJ Koning, Marlijn JA Kamps, Tom Dormans, Robert Stassen, Sebastiaan Weijer, Klaas-Sierk Arnold, Benjamin Tomlow, Hilde RH de Geus, Rozemarijn L van Bruchem-Visser, Jelle R Miedema, Annelies Verbon, Els van Nood, David M Kent, Stephanie CE Schuit, Hester Lingsma
medRxiv 2020.12.30.20249023; doi: https://doi.org/10.1101/2020.12.30.20249023
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
COVID Outcome Prediction in the Emergency Department (COPE): Development and validation of a model for predicting death and need for intensive care in COVID-19 patients
David van Klaveren, Alexandros Rekkas, Jelmer Alsma, Rob JCG Verdonschot, Dick TJJ Koning, Marlijn JA Kamps, Tom Dormans, Robert Stassen, Sebastiaan Weijer, Klaas-Sierk Arnold, Benjamin Tomlow, Hilde RH de Geus, Rozemarijn L van Bruchem-Visser, Jelle R Miedema, Annelies Verbon, Els van Nood, David M Kent, Stephanie CE Schuit, Hester Lingsma
medRxiv 2020.12.30.20249023; doi: https://doi.org/10.1101/2020.12.30.20249023

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Emergency Medicine
Subject Areas
All Articles
  • Addiction Medicine (215)
  • Allergy and Immunology (495)
  • Anesthesia (106)
  • Cardiovascular Medicine (1095)
  • Dentistry and Oral Medicine (195)
  • Dermatology (141)
  • Emergency Medicine (274)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (500)
  • Epidemiology (9764)
  • Forensic Medicine (5)
  • Gastroenterology (480)
  • Genetic and Genomic Medicine (2304)
  • Geriatric Medicine (222)
  • Health Economics (462)
  • Health Informatics (1555)
  • Health Policy (734)
  • Health Systems and Quality Improvement (603)
  • Hematology (236)
  • HIV/AIDS (503)
  • Infectious Diseases (except HIV/AIDS) (11637)
  • Intensive Care and Critical Care Medicine (616)
  • Medical Education (237)
  • Medical Ethics (67)
  • Nephrology (257)
  • Neurology (2140)
  • Nursing (134)
  • Nutrition (336)
  • Obstetrics and Gynecology (426)
  • Occupational and Environmental Health (517)
  • Oncology (1174)
  • Ophthalmology (364)
  • Orthopedics (128)
  • Otolaryngology (220)
  • Pain Medicine (145)
  • Palliative Medicine (50)
  • Pathology (310)
  • Pediatrics (694)
  • Pharmacology and Therapeutics (299)
  • Primary Care Research (266)
  • Psychiatry and Clinical Psychology (2179)
  • Public and Global Health (4653)
  • Radiology and Imaging (775)
  • Rehabilitation Medicine and Physical Therapy (457)
  • Respiratory Medicine (623)
  • Rheumatology (274)
  • Sexual and Reproductive Health (225)
  • Sports Medicine (210)
  • Surgery (250)
  • Toxicology (43)
  • Transplantation (120)
  • Urology (94)