Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Early risk assessment for COVID-19 patients from emergency department data using machine learning

View ORCID ProfileFrank S. Heldt, Marcela P. Vizcaychipi, View ORCID ProfileSophie Peacock, View ORCID ProfileMattia Cinelli, Lachlan McLachlan, View ORCID ProfileFernando Andreotti, Stojan Jovanović, View ORCID ProfileRobert Dürichen, View ORCID ProfileNadezda Lipunova, Robert A. Fletcher, Anne Hancock, Alex McCarthy, Richard A. Pointon, Alexander Brown, James Eaton, View ORCID ProfileRoberto Liddi, View ORCID ProfileLucy Mackillop, View ORCID ProfileLionel Tarassenko, Rabia T. Khan
doi: https://doi.org/10.1101/2020.05.19.20086488
Frank S. Heldt
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Frank S. Heldt
Marcela P. Vizcaychipi
2Chelsea and Westminster Hospital NHS Foundation Trust, 369 Fulham Road, London, SW10 9NH, UK
3Academic Department of Anaesthesia & Intensive Care Medicine, Imperial College London, Chelsea & Westminster Campus, 369 Fulham Road, London, SW10 9NH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sophie Peacock
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sophie Peacock
Mattia Cinelli
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Mattia Cinelli
Lachlan McLachlan
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fernando Andreotti
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Fernando Andreotti
Stojan Jovanović
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Dürichen
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Robert Dürichen
Nadezda Lipunova
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nadezda Lipunova
Robert A. Fletcher
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anne Hancock
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alex McCarthy
2Chelsea and Westminster Hospital NHS Foundation Trust, 369 Fulham Road, London, SW10 9NH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard A. Pointon
2Chelsea and Westminster Hospital NHS Foundation Trust, 369 Fulham Road, London, SW10 9NH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexander Brown
2Chelsea and Westminster Hospital NHS Foundation Trust, 369 Fulham Road, London, SW10 9NH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
James Eaton
2Chelsea and Westminster Hospital NHS Foundation Trust, 369 Fulham Road, London, SW10 9NH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Roberto Liddi
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Roberto Liddi
Lucy Mackillop
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
4Oxford University Hospitals NHS Foundation Trust, Women’s Centre, John Radcliffe Hospital, Headley Way, Headington, Oxford, OX3 9DU, UK
5Nuffield Department of Women’s and Reproductive Health, University of Oxford, Women’s Centre, John Radcliffe Hospital, Headley Way, Headington, Oxford, OX3 9DU, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lucy Mackillop
Lionel Tarassenko
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
6Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, OX3 7DQ
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lionel Tarassenko
Rabia T. Khan
1Sensyne Health plc, Schrodinger Building, Heatley Road, Oxford Science Park, Oxford, OX4 4GE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: rabia.khan@sensynehealth.com
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Since its emergence in late 2019, the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has caused a pandemic, with more than 4.8 million reported cases and 310 000 deaths worldwide. While epidemiological and clinical characteristics of COVID-19 have been reported, risk factors underlying the transition from mild to severe disease among patients remain poorly understood.

Methods In this retrospective study, we analysed data of 820 confirmed COVID-19 positive patients admitted to a two-site NHS Trust hospital in London, England, between January 1st and April 23rd, 2020, with a majority of cases occurring in March and April. We extracted anonymised demographic data, physiological clinical variables and laboratory results from electronic healthcare records (EHR) and applied multivariate logistic regression, random forest and extreme gradient boosted trees. To evaluate the potential for early risk assessment, we used data available during patients’ initial presentation at the emergency department (ED) to predict deterioration to one of three clinical endpoints in the remainder of the hospital stay: A) admission to intensive care, B) need for mechanical ventilation and C) mortality. Based on the trained models, we extracted the most informative clinical features in determining these patient trajectories.

Results Considering our inclusion criteria, we have identified 126 of 820 (15%) patients that required intensive care, 62 of 808 (8%) patients needing mechanical ventilation, and 170 of 630 (27%) cases of in-hospital mortality. Our models learned successfully from early clinical data and predicted clinical endpoints with high accuracy, the best model achieving AUC-ROC scores of 0.75 to 0.83 (F1 scores of 0.41 to 0.56). Younger patient age was associated with an increased risk of receiving intensive care and ventilation, but lower risk of mortality. Clinical indicators of a patient’s oxygen supply and selected laboratory results were most predictive of COVID-19 patient trajectories.

Conclusion Among COVID-19 patients machine learning can aid in the early identification of those with a poor prognosis, using EHR data collected during a patient’s first presentation at ED. Patient age and measures of oxygenation status during ED stay are primary indicators of poor patient outcomes.

Competing Interest Statement

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: FSH, MPV, SP, MC, LML, AM and RTK have a patent "Methods for predicting patient deterioration" based on this work pending. LM and LT are supported by the NIHR Oxford Biomedical Research Centre. FSH, SP, MC, LML, FA, SJ, RD, NL RF, AH, RL, LM, LT and RTK are employees of Sensyne Health plc, who develops the CVm-Health app for remote monitoring of COVID-19 symptoms.

Funding Statement

LM and LT are supported by the NIHR Oxford Biochemical Research Centre.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

The data are not publicly available.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted May 22, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Early risk assessment for COVID-19 patients from emergency department data using machine learning
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Early risk assessment for COVID-19 patients from emergency department data using machine learning
Frank S. Heldt, Marcela P. Vizcaychipi, Sophie Peacock, Mattia Cinelli, Lachlan McLachlan, Fernando Andreotti, Stojan Jovanović, Robert Dürichen, Nadezda Lipunova, Robert A. Fletcher, Anne Hancock, Alex McCarthy, Richard A. Pointon, Alexander Brown, James Eaton, Roberto Liddi, Lucy Mackillop, Lionel Tarassenko, Rabia T. Khan
medRxiv 2020.05.19.20086488; doi: https://doi.org/10.1101/2020.05.19.20086488
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
Early risk assessment for COVID-19 patients from emergency department data using machine learning
Frank S. Heldt, Marcela P. Vizcaychipi, Sophie Peacock, Mattia Cinelli, Lachlan McLachlan, Fernando Andreotti, Stojan Jovanović, Robert Dürichen, Nadezda Lipunova, Robert A. Fletcher, Anne Hancock, Alex McCarthy, Richard A. Pointon, Alexander Brown, James Eaton, Roberto Liddi, Lucy Mackillop, Lionel Tarassenko, Rabia T. Khan
medRxiv 2020.05.19.20086488; doi: https://doi.org/10.1101/2020.05.19.20086488

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (62)
  • Allergy and Immunology (142)
  • Anesthesia (46)
  • Cardiovascular Medicine (415)
  • Dentistry and Oral Medicine (70)
  • Dermatology (48)
  • Emergency Medicine (144)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (171)
  • Epidemiology (4861)
  • Forensic Medicine (3)
  • Gastroenterology (183)
  • Genetic and Genomic Medicine (676)
  • Geriatric Medicine (70)
  • Health Economics (192)
  • Health Informatics (630)
  • Health Policy (321)
  • Health Systems and Quality Improvement (206)
  • Hematology (85)
  • HIV/AIDS (156)
  • Infectious Diseases (except HIV/AIDS) (5343)
  • Intensive Care and Critical Care Medicine (331)
  • Medical Education (93)
  • Medical Ethics (24)
  • Nephrology (75)
  • Neurology (686)
  • Nursing (42)
  • Nutrition (115)
  • Obstetrics and Gynecology (126)
  • Occupational and Environmental Health (208)
  • Oncology (440)
  • Ophthalmology (140)
  • Orthopedics (36)
  • Otolaryngology (90)
  • Pain Medicine (35)
  • Palliative Medicine (16)
  • Pathology (129)
  • Pediatrics (194)
  • Pharmacology and Therapeutics (131)
  • Primary Care Research (84)
  • Psychiatry and Clinical Psychology (781)
  • Public and Global Health (1817)
  • Radiology and Imaging (325)
  • Rehabilitation Medicine and Physical Therapy (138)
  • Respiratory Medicine (255)
  • Rheumatology (86)
  • Sexual and Reproductive Health (69)
  • Sports Medicine (62)
  • Surgery (100)
  • Toxicology (23)
  • Transplantation (29)
  • Urology (37)