Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

COVID-19 Outpatient Screening: a Prediction Score for Adverse Events

View ORCID ProfileHaoqi Sun, Aayushee Jain, Michael J. Leone, Haitham S. Alabsi, Laura Brenner, Elissa Ye, Wendong Ge, Yu-Ping Shao, Christine Boutros, Ruopeng Wang, Ryan Tesh, Colin Magdamo, Sarah I. Collens, Wolfgang Ganglberger, Ingrid V. Bassett, James B. Meigs, Jayashree Kalpathy-Cramer, Matthew D. Li, Jacqueline Chu, Michael L. Dougan, Lawrence Stratton, Jonathan Rosand, Bruce Fischl, Sudeshna Das, Shibani Mukerji, Gregory K. Robbins, M. Brandon Westover
doi: https://doi.org/10.1101/2020.06.17.20134262
Haoqi Sun
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Haoqi Sun
Aayushee Jain
1Department of Neurology, Massachusetts General Hospital, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael J. Leone
1Department of Neurology, Massachusetts General Hospital, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Haitham S. Alabsi
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laura Brenner
2Harvard Medical School, Boston, MA
4Division of Pulmonary and Critical Care Medicine, Massachusetts General Hospital, Boston, MA
9Division of General Internal Medicine, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elissa Ye
1Department of Neurology, Massachusetts General Hospital, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wendong Ge
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yu-Ping Shao
1Department of Neurology, Massachusetts General Hospital, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christine Boutros
1Department of Neurology, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ruopeng Wang
5Department of Radiology, Massachusetts General Hospital, Boston, MA
6Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ryan Tesh
1Department of Neurology, Massachusetts General Hospital, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Colin Magdamo
1Department of Neurology, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sarah I. Collens
1Department of Neurology, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wolfgang Ganglberger
1Department of Neurology, Massachusetts General Hospital, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ingrid V. Bassett
2Harvard Medical School, Boston, MA
7Division of Infectious Diseases, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
James B. Meigs
2Harvard Medical School, Boston, MA
9Division of General Internal Medicine, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jayashree Kalpathy-Cramer
2Harvard Medical School, Boston, MA
5Department of Radiology, Massachusetts General Hospital, Boston, MA
6Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew D. Li
2Harvard Medical School, Boston, MA
5Department of Radiology, Massachusetts General Hospital, Boston, MA
6Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacqueline Chu
2Harvard Medical School, Boston, MA
7Division of Infectious Diseases, Massachusetts General Hospital, Boston, MA
9Division of General Internal Medicine, Massachusetts General Hospital, Boston, MA
10MGH Chelsea HealthCare Center, Chelsea, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael L. Dougan
2Harvard Medical School, Boston, MA
8Division of Gastroenterology, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lawrence Stratton
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan Rosand
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bruce Fischl
2Harvard Medical School, Boston, MA
5Department of Radiology, Massachusetts General Hospital, Boston, MA
6Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA
11MIT HST/CSAIL, Cambridge, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sudeshna Das
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shibani Mukerji
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gregory K. Robbins
2Harvard Medical School, Boston, MA
7Division of Infectious Diseases, Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M. Brandon Westover
1Department of Neurology, Massachusetts General Hospital, Boston, MA
2Harvard Medical School, Boston, MA
3Clinical Data AI Center (CDAC), Massachusetts General Hospital, Boston, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: mwestover@mgh.harvard.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background We sought to develop an automatable score to predict hospitalization, critical illness, or death in patients at risk for COVID-19 presenting for urgent care during the Massachusetts outbreak.

Methods Single-center study of adult outpatients seen in respiratory illness clinics (RICs) or the emergency department (ED), including development (n = 9381, March 7-May 2) and prospective (n = 2205, May 3-14) cohorts. Data was queried from Partners Enterprise Data Warehouse. Outcomes were hospitalization, critical illness or death within 7 days. We developed the COVID-19 Acuity Score (CoVA) using automatically extracted data from the electronic medical record and learning-to-rank ordinal logistic regression modeling. Calibration was assessed using predicted-to-observed ratio (E/O). Discrimination was assessed by C-statistics (AUC).

Results In the development cohort, 27.3%, 7.2%, and 1.1% of patients experienced hospitalization, critical illness, or death, respectively; and in the prospective cohort, 26.1%, 6.3%, and 0.5%. CoVA showed excellent performance in the development cohort (concurrent validation) for hospitalization (E/O: 1.00, AUC: 0.80); for critical illness (E/O: 1.00, AUC: 0.82); and for death (E/O: 1.00, AUC: 0.87). Performance in the prospective cohort (prospective validation) was similar for hospitalization (E/O: 1.01, AUC: 0.76); for critical illness (E/O 1.03, AUC: 0.79); and for death (E/O: 1.63, AUC=0.93). Among 30 predictors, the top five were age, diastolic blood pressure, blood oxygen saturation, COVID-19 testing status, and respiratory rate.

Conclusions CoVA is a prospectively validated automatable score to assessing risk for adverse outcomes related to COVID-19 infection in the outpatient setting.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

HS and ML were supported by a Developmental Award from the Harvard University Center for AIDS Research (HU CFAR NIH/NIAID fund 5P30AI060354-16). MBW was supported by the Glenn Foundation for Medical Research and American Federation for Aging Research through a Breakthroughs in Gerontology Grant; the American Academy of Sleep Medicine through an AASM Foundation Strategic Research Award; the Department of Defense through a subcontract from Moberg ICU Solutions, Inc, and by grants from the NIH (1R01NS102190, 1R01NS102574, 1R01NS107291, 1RF1AG064312). Dr. Westover is co-founder of Beacon Biosignals. S.M. was supported by the National Institute of Mental Health at the National Institutes of Health (K23MH115812) and the Harvard University Eleanor and Miles Shore Fellowship Program. JBM was supported for this work by the MGH Division of Clinical Research. BF was supported by the BRAIN Initiative Cell Census Network grant U01MH117023, the NIBIB (P41EB015896, 1R01EB023281, R01EB006758, R21EB018907, R01EB019956), NIA (1R56AG064027, 1R01AG064027, 5R01AG008122, R01AG016495), NIHM and NIMDKD (1-R21-DK-108277-01), NINDS (R01NS0525851, R21NS072652, R01NS070963, R01NS083534, 5U01NS086625,5U24NS10059103, R01NS105820), and Shared Instrumentation Grants 1S10RR023401, 1S10RR019307, and 1S10RR023043. BF received additional support from the NIH Blueprint for Neuroscience Research (5U01-MH093765), part of the Human Connectome Project. In addition, BF has a financial interest in CorticoMetrics, a company whose medical pursuits focus on brain imaging and measurement technologies. BF's interests were reviewed and are managed by Massachusetts General Hospital and Partners HealthCare in accordance with their conflict of interest policies.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

MGH IRB 2013P001024: A Database to Support Large-Scale Acute Care Research

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

The data is available upon request from the corresponding author if reasonable.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted June 22, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
COVID-19 Outpatient Screening: a Prediction Score for Adverse Events
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
COVID-19 Outpatient Screening: a Prediction Score for Adverse Events
Haoqi Sun, Aayushee Jain, Michael J. Leone, Haitham S. Alabsi, Laura Brenner, Elissa Ye, Wendong Ge, Yu-Ping Shao, Christine Boutros, Ruopeng Wang, Ryan Tesh, Colin Magdamo, Sarah I. Collens, Wolfgang Ganglberger, Ingrid V. Bassett, James B. Meigs, Jayashree Kalpathy-Cramer, Matthew D. Li, Jacqueline Chu, Michael L. Dougan, Lawrence Stratton, Jonathan Rosand, Bruce Fischl, Sudeshna Das, Shibani Mukerji, Gregory K. Robbins, M. Brandon Westover
medRxiv 2020.06.17.20134262; doi: https://doi.org/10.1101/2020.06.17.20134262
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
COVID-19 Outpatient Screening: a Prediction Score for Adverse Events
Haoqi Sun, Aayushee Jain, Michael J. Leone, Haitham S. Alabsi, Laura Brenner, Elissa Ye, Wendong Ge, Yu-Ping Shao, Christine Boutros, Ruopeng Wang, Ryan Tesh, Colin Magdamo, Sarah I. Collens, Wolfgang Ganglberger, Ingrid V. Bassett, James B. Meigs, Jayashree Kalpathy-Cramer, Matthew D. Li, Jacqueline Chu, Michael L. Dougan, Lawrence Stratton, Jonathan Rosand, Bruce Fischl, Sudeshna Das, Shibani Mukerji, Gregory K. Robbins, M. Brandon Westover
medRxiv 2020.06.17.20134262; doi: https://doi.org/10.1101/2020.06.17.20134262

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (76)
  • Allergy and Immunology (196)
  • Anesthesia (54)
  • Cardiovascular Medicine (489)
  • Dentistry and Oral Medicine (90)
  • Dermatology (56)
  • Emergency Medicine (168)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (211)
  • Epidemiology (5689)
  • Forensic Medicine (3)
  • Gastroenterology (216)
  • Genetic and Genomic Medicine (868)
  • Geriatric Medicine (88)
  • Health Economics (232)
  • Health Informatics (762)
  • Health Policy (392)
  • Health Systems and Quality Improvement (254)
  • Hematology (105)
  • HIV/AIDS (182)
  • Infectious Diseases (except HIV/AIDS) (6488)
  • Intensive Care and Critical Care Medicine (391)
  • Medical Education (117)
  • Medical Ethics (28)
  • Nephrology (93)
  • Neurology (850)
  • Nursing (44)
  • Nutrition (141)
  • Obstetrics and Gynecology (163)
  • Occupational and Environmental Health (262)
  • Oncology (514)
  • Ophthalmology (163)
  • Orthopedics (44)
  • Otolaryngology (107)
  • Pain Medicine (48)
  • Palliative Medicine (21)
  • Pathology (149)
  • Pediatrics (250)
  • Pharmacology and Therapeutics (146)
  • Primary Care Research (114)
  • Psychiatry and Clinical Psychology (969)
  • Public and Global Health (2231)
  • Radiology and Imaging (377)
  • Rehabilitation Medicine and Physical Therapy (174)
  • Respiratory Medicine (312)
  • Rheumatology (109)
  • Sexual and Reproductive Health (81)
  • Sports Medicine (82)
  • Surgery (118)
  • Toxicology (25)
  • Transplantation (34)
  • Urology (42)