Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Development and Validation of Early Warning Score Systems for COVID-19 Patients

View ORCID ProfileAlexey Youssef, Samaneh Kouchaki, Farah Shamout, Jacob Armstrong, Rasheed El-Bouri, Thomas Taylor, Drew Birrenkott, Baptiste Vasey, Andrew Soltan, Tingting Zhu, David A Clifton, David W Eyre
doi: https://doi.org/10.1101/2020.11.04.20225904
Alexey Youssef
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alexey Youssef
  • For correspondence: alexeyyoussef@gmail.com
Samaneh Kouchaki
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
bCentre for Vision, Speech, and Signal Processing, University of Surrey
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Farah Shamout
cNew York University Abu Dhabi, Engineering Division, Abu Dhabi, 129188, United Arab Emirates
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacob Armstrong
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
gBig Data Institute, Nuffield Department of Population Health, University of Oxford, Oxford, OX3 7LF
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rasheed El-Bouri
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas Taylor
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Drew Birrenkott
dStanford School of Medicine, Stanford University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Baptiste Vasey
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
dStanford School of Medicine, Stanford University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew Soltan
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
eNuffield Department of Surgical Sciences, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tingting Zhu
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David A Clifton
aInstitute of Biomedical Engineering, Dept. Engineering Science, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David W Eyre
fJohn Radcliffe Hospital, Oxford University Hospitals, Oxford, OX3 9DU
gBig Data Institute, Nuffield Department of Population Health, University of Oxford, Oxford, OX3 7LF
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

COVID-19 is a major, urgent, and ongoing threat to global health. Globally more than 24 million have been infected and the disease has claimed more than a million lives as of October 2020. Predicting which patients will need respiratory support is important to guiding individual patient treatment and also to ensuring sufficient resources are available. We evaluated the ability of six common Early Warning Scores (EWS) to identify respiratory deterioration defined as the need for advanced respiratory support (high-flow nasal oxygen, continuous positive airways pressure, non-invasive ventilation, intubation) within a prediction window of 24 hours. We show these scores perform sub-optimally at this specific task. Therefore, we develop an alternative Early Warning Score based on a Gradient Boosting Trees (GBT) algorithm that is able to predict deterioration within the next 24 hours with high AUROC 94% and an accuracy, sensitivity and specificity of 70%, 96%, 70%, respectively. Our GBT model outperformed the best EWS (LDTEWS:NEWS), increasing the AUROC by 14%. Our GBT model makes the prediction based on the current and baseline measures of routinely available vital signs and blood tests.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This research was supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Deidentified data from patients were obtained from the Infections in Oxfordshire Research Database (IORD) which has Research Ethics Committee, Health Research Authority and Confidentiality Advisory Group approvals (19/SC/0403, ECC5-017(A)/2009).

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Access to data can be sought through applying to access our dataset via the formal application process.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
Back to top
PreviousNext
Posted November 06, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Development and Validation of Early Warning Score Systems for COVID-19 Patients
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Development and Validation of Early Warning Score Systems for COVID-19 Patients
Alexey Youssef, Samaneh Kouchaki, Farah Shamout, Jacob Armstrong, Rasheed El-Bouri, Thomas Taylor, Drew Birrenkott, Baptiste Vasey, Andrew Soltan, Tingting Zhu, David A Clifton, David W Eyre
medRxiv 2020.11.04.20225904; doi: https://doi.org/10.1101/2020.11.04.20225904
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Development and Validation of Early Warning Score Systems for COVID-19 Patients
Alexey Youssef, Samaneh Kouchaki, Farah Shamout, Jacob Armstrong, Rasheed El-Bouri, Thomas Taylor, Drew Birrenkott, Baptiste Vasey, Andrew Soltan, Tingting Zhu, David A Clifton, David W Eyre
medRxiv 2020.11.04.20225904; doi: https://doi.org/10.1101/2020.11.04.20225904

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (238)
  • Allergy and Immunology (520)
  • Anesthesia (124)
  • Cardiovascular Medicine (1414)
  • Dentistry and Oral Medicine (217)
  • Dermatology (158)
  • Emergency Medicine (291)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (582)
  • Epidemiology (10275)
  • Forensic Medicine (6)
  • Gastroenterology (526)
  • Genetic and Genomic Medicine (2619)
  • Geriatric Medicine (254)
  • Health Economics (496)
  • Health Informatics (1728)
  • Health Policy (788)
  • Health Systems and Quality Improvement (671)
  • Hematology (266)
  • HIV/AIDS (564)
  • Infectious Diseases (except HIV/AIDS) (12075)
  • Intensive Care and Critical Care Medicine (647)
  • Medical Education (272)
  • Medical Ethics (83)
  • Nephrology (287)
  • Neurology (2450)
  • Nursing (144)
  • Nutrition (376)
  • Obstetrics and Gynecology (488)
  • Occupational and Environmental Health (566)
  • Oncology (1317)
  • Ophthalmology (398)
  • Orthopedics (145)
  • Otolaryngology (235)
  • Pain Medicine (168)
  • Palliative Medicine (51)
  • Pathology (342)
  • Pediatrics (776)
  • Pharmacology and Therapeutics (328)
  • Primary Care Research (295)
  • Psychiatry and Clinical Psychology (2392)
  • Public and Global Health (4991)
  • Radiology and Imaging (892)
  • Rehabilitation Medicine and Physical Therapy (522)
  • Respiratory Medicine (681)
  • Rheumatology (309)
  • Sexual and Reproductive Health (254)
  • Sports Medicine (244)
  • Surgery (296)
  • Toxicology (45)
  • Transplantation (140)
  • Urology (108)