Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison

Bàrbara Baro, Pau Rodo, Dan Ouchi, Antoni E. Bordoy, Emilio N. Saya Amaro, Sergi V. Salsench, Sònia Molinos, Andrea Alemany, Maria Ubals, Marc Corbacho-Monné, Pere Millat-Martinez, View ORCID ProfileMichael Marks, Bonaventura Clotet, Nuria Prat, Jordi Ara, Martí Vall-Mayans, Camila G-Beiras, Quique Bassat, Ignacio Blanco, Oriol Mitjà
doi: https://doi.org/10.1101/2021.02.11.21251553
Bàrbara Baro
1ISGlobal, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pau Rodo
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dan Ouchi
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Antoni E. Bordoy
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emilio N. Saya Amaro
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sergi V. Salsench
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sònia Molinos
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrea Alemany
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
14Faculty of Medicine and Health Sciences, University of Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maria Ubals
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
14Faculty of Medicine and Health Sciences, University of Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marc Corbacho-Monné
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
4Parc Taulí Hospital Universitari, Institut d’Investigació i Innovació Parc Taulí I3PT, Sabadell, Spain
14Faculty of Medicine and Health Sciences, University of Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pere Millat-Martinez
1ISGlobal, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael Marks
5Clinical Research Department, Faculty of Infectious & Tropical Diseases, London School of Hygiene & Tropical Medicine, London, UK
6Hospital for Tropical Diseases, University College London Hospital, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michael Marks
Bonaventura Clotet
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
7IrsiCaixa AIDS Research Institute, Germans Trias i Pujol Research Institute (IGTP), Badalona, Spain
8Universitat de Vic-Universitat Central de Catalunya (UVIC-UCC), Vic, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nuria Prat
9Gerència Territorial Metropolitana Nord, Institut Català de la Salut, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jordi Ara
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
9Gerència Territorial Metropolitana Nord, Institut Català de la Salut, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martí Vall-Mayans
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Camila G-Beiras
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Quique Bassat
1ISGlobal, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain
10Centro de Investigação em Saúde de Manhiça (CISM), Maputo, Mozambique
11ICREA, Pg. Lluís Companys 23, 08010 Barcelona, Spain
12Pediatrics Department, Hospital Sant Joan de Déu (University of Barcelona), Barcelona, Spain
13Consorcio de Investigación Biomédica en Red de Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ignacio Blanco
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
9Gerència Territorial Metropolitana Nord, Institut Català de la Salut, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Oriol Mitjà
2Fight AIDS and Infectious Diseases Foundation, Badalona, Spain
3Hospital Universitari Germans Trias i Pujol, Badalona, Spain
15Lihir Medical Centre - InternationalSOS, Lihir Island, Papua New Guinea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: omitja@flsida.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Mass testing for early identification and isolation of infectious COVID-19 individuals, irrespective of concurrent symptoms, is an efficacious strategy to reduce disease transmission. Antigen-detecting rapid diagnostic tests (Ag-RDT) appear as a potentially suitable tool for mass testing on account of their ease-of-use, fast turnaround time, and low cost. However, benchmark comparisons are scarce, particularly in the context of unexposed asymptomatic individuals.

Methods We used nasopharyngeal specimens from unexposed asymptomatic individuals to assess five Ag-RDTs: PanBio™ COVID-19 Ag Rapid test (Abbott), CLINITEST® Rapid COVID-19 Antigen Test (Siemens), SARS-CoV-2 Rapid Antigen Test (Roche Diagnostics), SARS-CoV-2 Antigen Rapid Test Kit (Lepu Medical), and COVID-19 Coronavirus Rapid Antigen Test Cassette (Surescreen). Samples were collected between December 2020-January 2021 during the third wave of the epidemic in Spain.

Findings The analysis included 101 specimens with confirmed positive PCR results and 185 with negative PCR. For the overall sample, the performance parameters of Ag-RDTs were as follows: Abbott assay, sensitivity 38·6% (95% CI 29·1–48·8) and specificity 99·5% (97–100%); Siemens, sensitivity 51·5% (41·3–61·6) and specificity 98·4% (95·3–99·6); Roche, sensitivity 43·6% (33·7–53·8) and specificity 96·2% (92·4–98·5); Lepu, sensitivity 45·5% (35·6–55·8) and specificity 89·2% (83·8–93·3%); Surescreen, sensitivity 28·8% (20·2–38·6) and specificity 97·8% (94·5–99·4%). For specimens with cycle threshold (Ct) <30 in RT-qPCR, all Ag-RDT achieved a sensitivity of at least 70%, with Siemens, Roche, and Lepu assays showing sensitivities higher than 80%. In models according to population prevalence, all Ag-RDTs will have a NPV >99% and a PPV<50% at 1% prevalence.

Interpretation Two commercial, widely available assays can be used for SARS-CoV-2 antigen testing to achieve sensitivity in specimens with a Ct<30 and specificity of at least 80% and 96%, respectively. Estimated negative and positive predictive values suggests the suitability of Ag-RDTs for mass screenings of SARS-CoV-2 infection in the general population.

Funding Blueberry diagnostics, Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, and #YoMeCorono.org crowdfunding campaign.

Evidence before this study In December 2020, we searched on PubMed for articles containing the terms “antigen”, “test” (or Ag-RDT), and “SARS-CoV-2” or “COVID-19” either in the title or the abstract. Our search yielded 79 entries corresponding to articles written in English. Of them, 33 were articles presenting the diagnostic performance of qualitative lateral-flow antigen-detecting rapid diagnostic tests (Ag-RDT). Four of these articles reported the results of head-to-head comparisons of various Ag-RDTs; in all cases, the number of tests was lower than the recommended for retrospective assessments of diagnostic performance (i.e., minimum of 100 PCR positive and 100 PCR negative). Furthermore, all head-to-head comparisons found in the literature included specimens obtained among individuals with varying disease status (none of which asymptomatic), thus limiting the adequacy of the estimates for an asymptomatic screening strategy.

Added value of this study We compared for the first time head-to-head five Ag-RDT using a powered set of fresh respiratory specimens PCR-confirmed positive or negative, collected from unexposed asymptomatic individuals during screening campaigns for early detection of SARS-CoV-2 infection. The sample size was large enough to draw robust conclusions. Our analysis identified four Ag-RDTs (i.e., assays marketed by Abbott, Siemens, Roche, and Surescreen) with specificity higher than 96%. Despite the low sensitivity for the overall sample (range 29% to 51%), the corresponding values for the subset of samples with Ct <30 were higher than 80% for Siemens, Roche, and Lepu assays. The estimated NPV for a screening performed in an area with 1% prevalence would be >99% for all tests, while the PPV would be <50%.

Implications of all the available evidence Current data on the diagnostic performance of Ag-RDTs is heterogeneous and precludes benchmark assessments. Furthermore, the screening of asymptomatic populations is currently not considered among the intended uses of Ag-RDT, mostly because of lack of evidence on test performance in samples from unexposed asymptomatic individuals. Our findings add to the current evidence in two ways: first, we provide benchmarking data on Ag-RDTs, assessed head-to-head in a single set of respiratory specimens; second, we provide data on the diagnostic performance of Ag-RDTs in unexposed asymptomatic individuals. Our findings support the idea that Ag-RDTs can be used for mass screening in low prevalence settings and accurately rule out a highly infectious case in such setting.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Blueberry diagnostics, Fundacio Institut d'Investigacio en Ciencies de la Salut Germans Trias i Pujol, and #YoMeCorono.org crowdfunding campaign.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study received approval from the Ethics Committe of the Hospital Universitari Germans Trias i Pujol

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Data are available upon request tp the corresponding author

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted February 12, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison
Bàrbara Baro, Pau Rodo, Dan Ouchi, Antoni E. Bordoy, Emilio N. Saya Amaro, Sergi V. Salsench, Sònia Molinos, Andrea Alemany, Maria Ubals, Marc Corbacho-Monné, Pere Millat-Martinez, Michael Marks, Bonaventura Clotet, Nuria Prat, Jordi Ara, Martí Vall-Mayans, Camila G-Beiras, Quique Bassat, Ignacio Blanco, Oriol Mitjà
medRxiv 2021.02.11.21251553; doi: https://doi.org/10.1101/2021.02.11.21251553
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison
Bàrbara Baro, Pau Rodo, Dan Ouchi, Antoni E. Bordoy, Emilio N. Saya Amaro, Sergi V. Salsench, Sònia Molinos, Andrea Alemany, Maria Ubals, Marc Corbacho-Monné, Pere Millat-Martinez, Michael Marks, Bonaventura Clotet, Nuria Prat, Jordi Ara, Martí Vall-Mayans, Camila G-Beiras, Quique Bassat, Ignacio Blanco, Oriol Mitjà
medRxiv 2021.02.11.21251553; doi: https://doi.org/10.1101/2021.02.11.21251553

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (161)
  • Allergy and Immunology (416)
  • Anesthesia (91)
  • Cardiovascular Medicine (860)
  • Dentistry and Oral Medicine (159)
  • Dermatology (98)
  • Emergency Medicine (250)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (394)
  • Epidemiology (8566)
  • Forensic Medicine (4)
  • Gastroenterology (385)
  • Genetic and Genomic Medicine (1755)
  • Geriatric Medicine (167)
  • Health Economics (373)
  • Health Informatics (1245)
  • Health Policy (622)
  • Health Systems and Quality Improvement (468)
  • Hematology (196)
  • HIV/AIDS (376)
  • Infectious Diseases (except HIV/AIDS) (10306)
  • Intensive Care and Critical Care Medicine (553)
  • Medical Education (192)
  • Medical Ethics (51)
  • Nephrology (212)
  • Neurology (1679)
  • Nursing (97)
  • Nutrition (252)
  • Obstetrics and Gynecology (326)
  • Occupational and Environmental Health (451)
  • Oncology (929)
  • Ophthalmology (263)
  • Orthopedics (102)
  • Otolaryngology (172)
  • Pain Medicine (114)
  • Palliative Medicine (40)
  • Pathology (253)
  • Pediatrics (536)
  • Pharmacology and Therapeutics (254)
  • Primary Care Research (208)
  • Psychiatry and Clinical Psychology (1772)
  • Public and Global Health (3845)
  • Radiology and Imaging (624)
  • Rehabilitation Medicine and Physical Therapy (320)
  • Respiratory Medicine (521)
  • Rheumatology (208)
  • Sexual and Reproductive Health (168)
  • Sports Medicine (158)
  • Surgery (190)
  • Toxicology (36)
  • Transplantation (101)
  • Urology (76)