Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Who should we test for COVID-19? A triage model built from national symptom surveys

Saar Shoer, Tal Karady, Ayya Keshet, Smadar Shilo, Hagai Rossman, Amir Gavrieli, Tomer Meir, Amit Lavon, Dmitry Kolobkov, Iris Kalka, Anastasia Godneva, Ori Cohen, Adam Kariv, Ori Hoch, Mushon Zer-Aviv, Noam Castel, Caroel Sudre, Anat Ekka Zohar, Angela Irony, Tim Spector, Benjamin Geiger, Dorit Hizi, Varda Shalev, Ran Balicer, Eran Segal
doi: https://doi.org/10.1101/2020.05.18.20105569
Saar Shoer
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tal Karady
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ayya Keshet
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Smadar Shilo
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
3Pediatric Diabetes Unit, Ruth Rappaport Children’s Hospital, Rambam Healthcare Campus, Haifa, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hagai Rossman
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amir Gavrieli
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tomer Meir
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amit Lavon
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dmitry Kolobkov
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Iris Kalka
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anastasia Godneva
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ori Cohen
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adam Kariv
4The public knowledge workshop, Tel Aviv
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ori Hoch
4The public knowledge workshop, Tel Aviv
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mushon Zer-Aviv
4The public knowledge workshop, Tel Aviv
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Noam Castel
4The public knowledge workshop, Tel Aviv
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caroel Sudre
6Department of Twin Research, King’s College London
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anat Ekka Zohar
5Epidemiology and Database Research Unit, Maccabi Healthcare Services, Tel Aviv, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Angela Irony
5Epidemiology and Database Research Unit, Maccabi Healthcare Services, Tel Aviv, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tim Spector
6Department of Twin Research, King’s College London
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin Geiger
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dorit Hizi
4The public knowledge workshop, Tel Aviv
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Varda Shalev
5Epidemiology and Database Research Unit, Maccabi Healthcare Services, Tel Aviv, Israel
8School of Public Health, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ran Balicer
7Clalit Research Institute, Clalit Health Services, Tel Aviv, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eran Segal
1Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel
2Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: eran.segal@weizmann.ac.il
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

The gold standard for COVID-19 diagnosis is detection of viral RNA in a reverse transcription PCR test. Due to global limitations in testing capacity, effective prioritization of individuals for testing is essential. Here, we devised a model that estimates the probability of an individual to test positive for COVID-19 based on answers to 9 simple questions regarding age, gender, presence of prior medical conditions, general feeling, and the symptoms fever, cough, shortness of breath, sore throat and loss of taste or smell, all of which have been associated with COVID-19 infection. Our model was devised from a subsample of a national symptom survey that was answered over 2 million times in Israel over the past 2 months and a targeted survey distributed to all residents of several cities in Israel. Overall, 43,752 adults were included, from which 498 self-reported as being COVID-19 positive. We successfully validated the model on held-out individuals from Israel where it achieved a positive predictive value (PPV) of 46.3% at a 10% sensitivity and demonstrated its applicability outside of Israel by further validating it on an independently collected symptom survey dataset from the U.K., U.S. and Sweden, where it achieved a PPV of 34.7% at 10% sensitivity. Moreover, evaluating the model’s performance on this latter independent dataset on entries collected one week prior to the PCR test and up to the day of the test we found the highest performance on the day of the test. As our tool can be used online and without the need of exposure to suspected patients, it may have worldwide utility in combating COVID-19 by better directing the limited testing resources through prioritization of individuals for testing, thereby increasing the rate at which positive individuals can be identified and isolated.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

no external funding was received

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study protocol was approved by the Weizmann Institute of Science review board (IRB). Informed consent was waived by the IRB, as all identifying details of the participants were removed before the computational analysis. Participants were made fully aware of the way in which the data will be stored, handled and shared, which was provided to them and is in accord with the privacy and data-protection policy of the Weizmann Institute of Science (https://weizmann.ac.il/pages/privacy-policy).

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Models and tables of de-identified, aggregated data are available at https://github.com/hrossman/Covid19-Survey.

https://github.com/hrossman/Covid19-Survey

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted June 08, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Who should we test for COVID-19? A triage model built from national symptom surveys
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Who should we test for COVID-19? A triage model built from national symptom surveys
Saar Shoer, Tal Karady, Ayya Keshet, Smadar Shilo, Hagai Rossman, Amir Gavrieli, Tomer Meir, Amit Lavon, Dmitry Kolobkov, Iris Kalka, Anastasia Godneva, Ori Cohen, Adam Kariv, Ori Hoch, Mushon Zer-Aviv, Noam Castel, Caroel Sudre, Anat Ekka Zohar, Angela Irony, Tim Spector, Benjamin Geiger, Dorit Hizi, Varda Shalev, Ran Balicer, Eran Segal
medRxiv 2020.05.18.20105569; doi: https://doi.org/10.1101/2020.05.18.20105569
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Who should we test for COVID-19? A triage model built from national symptom surveys
Saar Shoer, Tal Karady, Ayya Keshet, Smadar Shilo, Hagai Rossman, Amir Gavrieli, Tomer Meir, Amit Lavon, Dmitry Kolobkov, Iris Kalka, Anastasia Godneva, Ori Cohen, Adam Kariv, Ori Hoch, Mushon Zer-Aviv, Noam Castel, Caroel Sudre, Anat Ekka Zohar, Angela Irony, Tim Spector, Benjamin Geiger, Dorit Hizi, Varda Shalev, Ran Balicer, Eran Segal
medRxiv 2020.05.18.20105569; doi: https://doi.org/10.1101/2020.05.18.20105569

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (215)
  • Allergy and Immunology (495)
  • Anesthesia (106)
  • Cardiovascular Medicine (1094)
  • Dentistry and Oral Medicine (195)
  • Dermatology (141)
  • Emergency Medicine (274)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (500)
  • Epidemiology (9760)
  • Forensic Medicine (5)
  • Gastroenterology (480)
  • Genetic and Genomic Medicine (2304)
  • Geriatric Medicine (222)
  • Health Economics (462)
  • Health Informatics (1554)
  • Health Policy (734)
  • Health Systems and Quality Improvement (603)
  • Hematology (236)
  • HIV/AIDS (502)
  • Infectious Diseases (except HIV/AIDS) (11637)
  • Intensive Care and Critical Care Medicine (616)
  • Medical Education (236)
  • Medical Ethics (67)
  • Nephrology (257)
  • Neurology (2140)
  • Nursing (134)
  • Nutrition (336)
  • Obstetrics and Gynecology (426)
  • Occupational and Environmental Health (517)
  • Oncology (1173)
  • Ophthalmology (363)
  • Orthopedics (128)
  • Otolaryngology (220)
  • Pain Medicine (145)
  • Palliative Medicine (50)
  • Pathology (309)
  • Pediatrics (694)
  • Pharmacology and Therapeutics (298)
  • Primary Care Research (266)
  • Psychiatry and Clinical Psychology (2176)
  • Public and Global Health (4649)
  • Radiology and Imaging (775)
  • Rehabilitation Medicine and Physical Therapy (456)
  • Respiratory Medicine (623)
  • Rheumatology (274)
  • Sexual and Reproductive Health (225)
  • Sports Medicine (210)
  • Surgery (250)
  • Toxicology (43)
  • Transplantation (120)
  • Urology (94)