Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Clinical prediction rule for SARS-CoV-2 infection from 116 U.S. emergency departments

View ORCID ProfileJeffrey A. Kline, Carlos A. Camargo, D. Mark Courtney, Christopher Kabrhel, Kristen E. Nordenholz, Thomas Aufderheide, Joshua Baugh, David Beiser, Christopher Bennett, Joseph Bledsoe, Edward Castillo, Makini Chisholm-Straker, Elizabeth Goldberg, Hans House, Stacey House, Timothy Jang, Chris Kabrhel, Stephen Lim, Troy Madsen, Danielle McCarthy, Andrew Meltzer, Stephen Moore, Craig Newgard, Justine Pagenhardt, Katherine L. Pettit, Michael Pulia, Michael Puskarich, Lauren Southerland, Scott Sparks, Danielle Turner-Lawrence, Marie Vrablik, Alfred Wang, Anthony Weekes, Lauren Westafer, John Wilburn
doi: https://doi.org/10.1101/2021.01.20.21249656
Jeffrey A. Kline
1Indiana University School of Medicine, Indianapolis, IN
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jeffrey A. Kline
  • For correspondence: jefkline{at}iu.edu
Carlos A. Camargo
2Massachusetts General Hospital, Harvard Medical School, Boston, MA
MD, DrPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
D. Mark Courtney
3University of Texas Southwestern, Dallas, TX
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher Kabrhel
4Massachusetts General Hospital, Boston, MA
3University of Texas Southwestern, Dallas, TX
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kristen E. Nordenholz
5University of Colorado School of Medicine, Aurora, CO
3University of Texas Southwestern, Dallas, TX
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas Aufderheide
6Medical College of Wisconsin, Milwaukee, WI
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joshua Baugh
4Massachusetts General Hospital, Boston, MA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Beiser
8University of Chicago School of Medicine, Chicago, IL
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher Bennett
9Stanford University School of Medicine, Palo Alto, CA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joseph Bledsoe
10Healthcare Delivery Institute, Intermountain Healthcare, Salt Lake City, UT
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edward Castillo
11University of California, San Diego, San Diego, CA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Makini Chisholm-Straker
12Mt. Sinai School of Medicine, New York, NY
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth Goldberg
13Warren Alpert Medical School of Brown University, Providence, RI
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hans House
14University of Iowa School of Medicine, Iowa City, IA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stacey House
15Washington University School of Medicine, St. Louise, MO
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Timothy Jang
16David Geffen School of Medicine at UCLA, Los Angeles, CA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chris Kabrhel
4Massachusetts General Hospital, Boston, MA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen Lim
18Louisiana State University School of Medicine, New Orleans, New Orleans, LA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Troy Madsen
19University of Utah School of Medicine, Salt Lake City, UT
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Danielle McCarthy
20Northwestern University, Feinberg School of Medicine, Chicago, IL
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew Meltzer
21George Washington University School of Medicine, Washington, DC, DC
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen Moore
22Penn State Milton S. Hershey Medical Center, Hershey, PA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Craig Newgard
23Oregon Health and Science University, Portland, OR
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Justine Pagenhardt
24West Virginia University School of Medicine, Morgantown, WV
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Katherine L. Pettit
1Indiana University School of Medicine, Indianapolis, IN
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael Pulia
26University of Wisconsin School of Medicine and Public Health, Madison, WI
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael Puskarich
27Hennepin County Medical Center and the University of Minnesota, Minneapolis, MN
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lauren Southerland
28Ohio State University Medical Center, Columbus, OH
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Scott Sparks
29Riverside Regional Medical Center, Newport News, VA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Danielle Turner-Lawrence
30Beaumont Health, Royal Oak, MI
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marie Vrablik
31University of Washington School of Medicine, Seattle, WA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alfred Wang
1Indiana University School of Medicine, Indianapolis, IN
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anthony Weekes
33Atrium Health Charlotte, NC
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lauren Westafer
34Baystate Health, Springfield, MA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Wilburn
35Wayne State University School of Medicine, Detroit, MI
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Objectives Accurate and reliable criteria to rapidly estimate the probability of infection with the novel coronavirus-2 that causes the severe acute respiratory syndrome (SARS-CoV-2) and associated disease (COVID-19) remain an urgent unmet need, especially in emergency care. The objective was to derive and validate a clinical prediction rule for SARS-CoV-2 infection that uses simple criteria widely available at the point of care.

Methods Data came from the Registry data from the national REgistry of suspected COVID-19 in EmeRgency care (RECOVER network) comprising 116 hospitals from 25 states in the US. Clinical predictors and 30-day outcomes were abstracted from medical records of 19,850 emergency department (ED) patients tested for SARS-CoV-2. The criterion standard for diagnosis of SARS-CoV-2 required a positive molecular test from a swabbed sample or positive antibody testing within 30 days. The prediction rule was derived from a 50% random sample (n=9,925) using unadjusted analysis of 107 candidate variables as a screening step, followed by stepwise forward logistic regression on 72 variables.

Results Multivariable regression yielded a 13-variable score, which was simplified to 13-point rule: +1 point each for age>50 years, measured temperature>37.5°C, oxygen saturation<95%, Black race, Hispanic or Latino ethnicity, household contact with known or suspected COVID-19, patient reported history of dry cough, anosmia/dysgeusia, myalgias or fever; and -1 point each for White race, no direct contact with infected person, or smoking. In the validation sample (n=9,975), the score produced an area under the receiver operating character curve of 0.80 (95% CI: 0.79-0.81), and this level of accuracy was retained across patients enrolled from the early spring to summer of 2020. In the simplified rule, a score of zero produced a sensitivity of 95.6% (94.8-96.3%), specificity of 20.0% (19.0-21.0%), likelihood ratio negative of 0.22 (0.19-0.26). Increasing points on the simplified rule predicted higher probability of infection (e.g., >75% probability with +5 or more points).

Conclusion Criteria that are available at the point of care can accurately predict the probability of SARS-CoV-2 infection. These criteria could assist with decision about isolation and testing at high throughput checkpoints.

Question Can clinical criteria, derived solely from interview and vital signs accurately estimate the probability of infection from the novel coronavirus (SARS-CoV-2) that causes COVID-19?

Findings From derivation sample (n=9,925), we derived a set of 13 clinical criteria that produced an area under the receiver operating characteristic curve of 0.80 (0.79-0.81) in a validation sample (n=9,925). At a score of zero, the simplified version of the criteria produced sensitivity of 95.6% (94.8 to 96.3%), and specificity of 20.0% (19.0 to 21.0%).

Meaning Clinical criteria can estimate the probability of SARS-CoV-2 infection.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Trial

Not a trial

Clinical Protocols

https://pubmed.ncbi.nlm.nih.gov/33392542/

Funding Statement

None

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Exempted from Human Subjects research by the Indiana University School of Medicine IRB

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Author contributions

  • ↵1 funding

  • ↵2 conception of idea

  • ↵3 data collection

  • ↵4 analysis

  • ↵5 drafting of manuscript

  • ↵6 critical analysis and editing of manuscript

  • ↵7 approval of final manuscript

  • Funding: Unrestricted internal funds

  • Conflict of Interest: The authors have no competing interests to declare.

Data Availability

Available to public after June 2021

Data Availability

All code used in this project is publicly available here: https://osf.io/p9ntr/ Due to individual site IRB restrictions, data is not publicly available. Please contact the ENIGMA CHR Working Group co-chairs if you are interested in joining and participating in the working group. Then you will be able to submit secondary data proposals.

https://osf.io/p9ntr/

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted January 22, 2021.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Clinical prediction rule for SARS-CoV-2 infection from 116 U.S. emergency departments
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Clinical prediction rule for SARS-CoV-2 infection from 116 U.S. emergency departments
Jeffrey A. Kline, Carlos A. Camargo, D. Mark Courtney, Christopher Kabrhel, Kristen E. Nordenholz, Thomas Aufderheide, Joshua Baugh, David Beiser, Christopher Bennett, Joseph Bledsoe, Edward Castillo, Makini Chisholm-Straker, Elizabeth Goldberg, Hans House, Stacey House, Timothy Jang, Chris Kabrhel, Stephen Lim, Troy Madsen, Danielle McCarthy, Andrew Meltzer, Stephen Moore, Craig Newgard, Justine Pagenhardt, Katherine L. Pettit, Michael Pulia, Michael Puskarich, Lauren Southerland, Scott Sparks, Danielle Turner-Lawrence, Marie Vrablik, Alfred Wang, Anthony Weekes, Lauren Westafer, John Wilburn
medRxiv 2021.01.20.21249656; doi: https://doi.org/10.1101/2021.01.20.21249656
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Clinical prediction rule for SARS-CoV-2 infection from 116 U.S. emergency departments
Jeffrey A. Kline, Carlos A. Camargo, D. Mark Courtney, Christopher Kabrhel, Kristen E. Nordenholz, Thomas Aufderheide, Joshua Baugh, David Beiser, Christopher Bennett, Joseph Bledsoe, Edward Castillo, Makini Chisholm-Straker, Elizabeth Goldberg, Hans House, Stacey House, Timothy Jang, Chris Kabrhel, Stephen Lim, Troy Madsen, Danielle McCarthy, Andrew Meltzer, Stephen Moore, Craig Newgard, Justine Pagenhardt, Katherine L. Pettit, Michael Pulia, Michael Puskarich, Lauren Southerland, Scott Sparks, Danielle Turner-Lawrence, Marie Vrablik, Alfred Wang, Anthony Weekes, Lauren Westafer, John Wilburn
medRxiv 2021.01.20.21249656; doi: https://doi.org/10.1101/2021.01.20.21249656

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Emergency Medicine
Subject Areas
All Articles
  • Addiction Medicine (427)
  • Allergy and Immunology (753)
  • Anesthesia (220)
  • Cardiovascular Medicine (3281)
  • Dentistry and Oral Medicine (362)
  • Dermatology (274)
  • Emergency Medicine (478)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1164)
  • Epidemiology (13340)
  • Forensic Medicine (19)
  • Gastroenterology (897)
  • Genetic and Genomic Medicine (5130)
  • Geriatric Medicine (479)
  • Health Economics (781)
  • Health Informatics (3253)
  • Health Policy (1138)
  • Health Systems and Quality Improvement (1189)
  • Hematology (427)
  • HIV/AIDS (1014)
  • Infectious Diseases (except HIV/AIDS) (14613)
  • Intensive Care and Critical Care Medicine (910)
  • Medical Education (475)
  • Medical Ethics (126)
  • Nephrology (522)
  • Neurology (4901)
  • Nursing (261)
  • Nutrition (725)
  • Obstetrics and Gynecology (880)
  • Occupational and Environmental Health (795)
  • Oncology (2516)
  • Ophthalmology (722)
  • Orthopedics (280)
  • Otolaryngology (346)
  • Pain Medicine (323)
  • Palliative Medicine (90)
  • Pathology (540)
  • Pediatrics (1298)
  • Pharmacology and Therapeutics (548)
  • Primary Care Research (554)
  • Psychiatry and Clinical Psychology (4193)
  • Public and Global Health (7482)
  • Radiology and Imaging (1702)
  • Rehabilitation Medicine and Physical Therapy (1010)
  • Respiratory Medicine (979)
  • Rheumatology (478)
  • Sexual and Reproductive Health (495)
  • Sports Medicine (424)
  • Surgery (546)
  • Toxicology (71)
  • Transplantation (235)
  • Urology (203)