Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Accuracy and usability of saliva and nasal rapid antigen self-testing for detection of SARS-CoV-2 infection in the general population: a head-to-head comparison

View ORCID ProfileEwoud Schuit, View ORCID ProfileRoderick P Venekamp, View ORCID ProfileIrene K Veldhuijzen, View ORCID ProfileWouter van den Bijllaardt, View ORCID ProfileSuzan D Pas, View ORCID ProfileJoep J J M Stohr, Esther B Lodder, View ORCID ProfileMarloes Hellwich, View ORCID ProfileRichard Molenkamp, View ORCID ProfileZsofia Igloi, Constantijn Wijers, Irene H Vroom, View ORCID ProfileCarla R S Nagel-Imming, View ORCID ProfileWanda G H Han, View ORCID ProfileJan AJW Kluytmans, View ORCID ProfileSusan van den Hof, View ORCID ProfileJanneke H H M van de Wijgert, View ORCID ProfileKarel G M Moons
doi: https://doi.org/10.1101/2021.12.08.21267452
Ewoud Schuit
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
2Cochrane Netherlands, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ewoud Schuit
Roderick P Venekamp
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Roderick P Venekamp
Irene K Veldhuijzen
3Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Antonie van Leeuwenhoeklaan 9, 3721 MA Bilthoven, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Irene K Veldhuijzen
Wouter van den Bijllaardt
4Microvida Laboratory for Medical Microbiology, Amphia Hospital, Molengracht 21, 4818 CK Breda, The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Wouter van den Bijllaardt
Suzan D Pas
4Microvida Laboratory for Medical Microbiology, Amphia Hospital, Molengracht 21, 4818 CK Breda, The Netherlands
5Microvida Laboratory for Medical Microbiology, Bravis Hospital, Boerhaavelaan 25 4708 AE Roosendaal, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Suzan D Pas
Joep J J M Stohr
10Department of Infection Control, Amphia Hospital, Molengracht 21, 4818 CK Breda, the Netherlands
11Microvida Laboratory for Medical Microbiology, Elisabeth-TweeSteden Hospital, Hilvarenbeekseweg 60 5022 GC Tilburg, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Joep J J M Stohr
Esther B Lodder
6Public Health Service West-Brabant, Doornboslaan 225-227, 4816 CZ Breda, The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marloes Hellwich
7Public Health Service Hart voor Brabant, Reitseplein 3, 5037 AA Tilburg, The Netherlands
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Marloes Hellwich
Richard Molenkamp
8Department of Viroscience, Erasmus MC, Doctor Molewaterplein 40, 3015 GD Rotterdam, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Richard Molenkamp
Zsofia Igloi
8Department of Viroscience, Erasmus MC, Doctor Molewaterplein 40, 3015 GD Rotterdam, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Zsofia Igloi
Constantijn Wijers
9Public Health Service Rotterdam-Rijnmond, Schiedamsedijk 95, 3011 EN Rotterdam, The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Irene H Vroom
9Public Health Service Rotterdam-Rijnmond, Schiedamsedijk 95, 3011 EN Rotterdam, The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carla R S Nagel-Imming
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Carla R S Nagel-Imming
Wanda G H Han
3Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Antonie van Leeuwenhoeklaan 9, 3721 MA Bilthoven, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Wanda G H Han
Jan AJW Kluytmans
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jan AJW Kluytmans
Susan van den Hof
3Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Antonie van Leeuwenhoeklaan 9, 3721 MA Bilthoven, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Susan van den Hof
Janneke H H M van de Wijgert
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Janneke H H M van de Wijgert
Karel G M Moons
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
2Cochrane Netherlands, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Karel G M Moons
  • For correspondence: k.g.m.moons@umcutrecht.nl
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background SARS-CoV-2 self-tests may lower the threshold of testing and produce a result quickly. This could support the early detection of infectious cases and reduce further community transmission. However, the diagnostic accuracy of (unsupervised) self-testing with rapid antigen diagnostic tests (Ag-RDTs) is mostly unknown. We therefore conducted a large-scale head-to-head comparison of the diagnostic accuracy of a self-performed SARS-CoV-2 saliva and nasal Ag-RDT, each compared to a molecular reference test, in the general population in the Netherlands.

Methods In this cross-sectional study we consecutively included individuals aged 16 years and older presenting for SARS-CoV-2 testing at three Dutch public health service test sites irrespective of their indication for testing, vaccination status, and symptomatology. Participants were sampled for molecular testing at the test site and received two self-tests (the Hangzhou AllTest saliva self-test and the SD Biosensor nasal self-test by Roche Diagnostics) to perform at home within a few hours without knowledge of their molecular test result. Information on presence and type of symptoms, user experiences, and results of both self-tests were collected via an online questionnaire. For each self-test, sensitivity, specificity, positive and negative predictive values were determined with molecular testing as reference standard.

Findings The SARS-CoV-2 molecular reference test positivity rate was 6.5% in the 2,819 participants. Overall sensitivities with 95% confidence intervals were 46.7% (85/182; 39.3%-54.2%) for the saliva Ag-RDT, and 68.9% (124/180; 61.6%-75.6%) for the nasal Ag-RDT. With a viral load cut-off (≥5.2 log10 SARS-CoV-2 E-gene copies/mL) as a proxy of infectiousness, sensitivities increased to 54.9% (78/142; 46.4%-63.3%) for the saliva Ag-RDT and 83.9% (120/143; 76.9%-89.5%) for the nasal Ag-RDT.

For the nasal Ag-RDT, sensitivities were 78.5% [71.1%-84.8%] and 22.6% [9.6%-41.1%] in those with and without symptoms at the time of sampling, which increased to 90.4% (113/125; 83.8%-94.9%) and 38.9% (7/18; 17.3%-64.3%) after applying the viral load cut-off. In those with and without prior confirmed SARS-CoV-2, sensitivities were 36.8% [19/372; 16.3%-61.6%] and 72.7% [161/2437; 65.1%-79.4%] for the nasal Ag-RDT, which increased to 100% (7/7; 59.0%-100%) and 83.1% (113/126; 75.7%-89.0%) after applying the viral load cut-off.

The diagnostic accuracy of the nasal Ag-RDT did not differ by COVID-19 vaccination status, sex, and age. Specificities were >99%, positive predictive values >70% and negative predictive values >95%, for the saliva Ag-RDT, and >99%, >90%, and >95% for the nasal Ag-RDT, respectively, in most analyses.

Interpreting the results was considered (very) easy for both self-tests.

Interpretation The Hangzhou AllTest self-performed saliva Ag-RDT is not reliable for SARS-CoV-2 infection detection overall nor in the studied subgroups. The SD Biosensor self-performed nasal Ag-RDT had high sensitivity in individuals with symptoms and in those without a prior SARS-CoV-2 infection. The overall accuracy in individuals with symptoms was comparable to that found in previous studies with professional sampling for this Ag-RDT. The extremely low sensitivity of the nasal Ag-RDT in asymptomatic individuals and in individuals who had had a prior SARS-CoV-2 infection is an important finding and warrants further investigation.

Funding Dutch Ministry of Health, Welfare, and Sport.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Dutch Ministry of Health, Welfare, and Sport

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Ethical approval was not required because the study was judged by the METC Utrecht to be outside the scope of the Dutch Medical Research Involving Human Subjects Act (protocol No 21-470 /C). All participants signed an informed consent form before any study procedure.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • ↵* Dual first authorship

  • ↵# Dual last authorship

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
Back to top
PreviousNext
Posted December 11, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Accuracy and usability of saliva and nasal rapid antigen self-testing for detection of SARS-CoV-2 infection in the general population: a head-to-head comparison
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Accuracy and usability of saliva and nasal rapid antigen self-testing for detection of SARS-CoV-2 infection in the general population: a head-to-head comparison
Ewoud Schuit, Roderick P Venekamp, Irene K Veldhuijzen, Wouter van den Bijllaardt, Suzan D Pas, Joep J J M Stohr, Esther B Lodder, Marloes Hellwich, Richard Molenkamp, Zsofia Igloi, Constantijn Wijers, Irene H Vroom, Carla R S Nagel-Imming, Wanda G H Han, Jan AJW Kluytmans, Susan van den Hof, Janneke H H M van de Wijgert, Karel G M Moons
medRxiv 2021.12.08.21267452; doi: https://doi.org/10.1101/2021.12.08.21267452
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Accuracy and usability of saliva and nasal rapid antigen self-testing for detection of SARS-CoV-2 infection in the general population: a head-to-head comparison
Ewoud Schuit, Roderick P Venekamp, Irene K Veldhuijzen, Wouter van den Bijllaardt, Suzan D Pas, Joep J J M Stohr, Esther B Lodder, Marloes Hellwich, Richard Molenkamp, Zsofia Igloi, Constantijn Wijers, Irene H Vroom, Carla R S Nagel-Imming, Wanda G H Han, Jan AJW Kluytmans, Susan van den Hof, Janneke H H M van de Wijgert, Karel G M Moons
medRxiv 2021.12.08.21267452; doi: https://doi.org/10.1101/2021.12.08.21267452

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (269)
  • Allergy and Immunology (549)
  • Anesthesia (134)
  • Cardiovascular Medicine (1747)
  • Dentistry and Oral Medicine (238)
  • Dermatology (172)
  • Emergency Medicine (310)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (653)
  • Epidemiology (10780)
  • Forensic Medicine (8)
  • Gastroenterology (584)
  • Genetic and Genomic Medicine (2933)
  • Geriatric Medicine (286)
  • Health Economics (531)
  • Health Informatics (1918)
  • Health Policy (833)
  • Health Systems and Quality Improvement (743)
  • Hematology (290)
  • HIV/AIDS (627)
  • Infectious Diseases (except HIV/AIDS) (12496)
  • Intensive Care and Critical Care Medicine (684)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (321)
  • Neurology (2780)
  • Nursing (150)
  • Nutrition (431)
  • Obstetrics and Gynecology (554)
  • Occupational and Environmental Health (597)
  • Oncology (1454)
  • Ophthalmology (440)
  • Orthopedics (172)
  • Otolaryngology (255)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (379)
  • Pediatrics (865)
  • Pharmacology and Therapeutics (362)
  • Primary Care Research (333)
  • Psychiatry and Clinical Psychology (2630)
  • Public and Global Health (5338)
  • Radiology and Imaging (1002)
  • Rehabilitation Medicine and Physical Therapy (594)
  • Respiratory Medicine (722)
  • Rheumatology (329)
  • Sexual and Reproductive Health (288)
  • Sports Medicine (278)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (149)
  • Urology (125)