Abstract
In 731 persons seeking COVID-19 testing at a walk-up San Francisco community site in January 2022, simultaneous nasal rapid antigen testing (BinaxNOW™) and RT-PCR testing was performed. There were 296 (40.5%) positive tests by RT-PCR; 98.5% of a random sample were the omicron variant. Sensitivity of a single antigen test was 95.2% (95% CI 92-98%); 82.1% (95% CI 77-87%) and 65.2% (95% CI 60-70%) for Ct threshold of < 30, < 35 and no threshold, respectively. We also compared BinaxNOW™ to RT-PCR from oral cheek swabs to nasal swabs (N=75); oral specimen was significantly less sensitive than nasal swab. A single BinaxNOW™ oral rapid antigen test failed to detect 91% (20 of 22) of specimens that were BinaxNOW™ positive from the standard nasal sampling. BinaxNOW™ continues to be a very useful diagnostic during the omicron surge. As currently recommended, repeat testing should be done for high-risk persons with an initial negative antigen test result.
Introduction
SARS CoV-2 rapid antigen tests are a valuable public health tool in the ongoing COVID-19 pandemic. They enable immediate identification of active SARS-CoV-2 infection with high viral levels, which can lead to faster isolation and curtail transmission chains (1). Antigen tests also enable rapid diagnosis needed for initiation of time-sensitive outpatient COVID-19 therapies. Many community testing programs, including school programs, utilize rapid tests; home antigen testing is increasingly becoming available in the United States and is widely available in some countries. Widespread use of rapid antigen tests is based on performance evaluations in the context of the ancestral, alpha, or delta variants (2).
It is vital to evaluate performance of rapid antigen tests when new SARS-CoV-2 variants emerge. The omicron variant has over 50 mutations compared to ancestral lineages; the majority are in the spike protein, but 4 are in the nucleocapsid gene, the target gene in the BinaxNOW assay. While laboratory studies suggest that the performance of BinaxNOW should not be affected when used to detect the omicron variant, field validation is needed (3). We sought to examine performance of the BinaxNOW rapid antigen tests at our community-based site in the Mission District in San Francisco, a setting in which we have routinely used this test and have evaluated its performance with previous variants (4,5).
Methods
This report includes data collected January 3-4, 2022 at our free, outdoor, walk-up testing and vaccine site situated in an outdoor parking lot in the heart of the Mission Cultural District in San Francisco. The site is led by Unidos en Salud – an academic (UCSF and Chan Zuckerberg Biohub), community (Latino Task Force), and public health (San Francisco Department of Public Health) collaboration that conducts SARS CoV 2 surveillance and serves communities at highest COVID-19 risk (4,5,6). Unidos en Salud serves a San Francisco community with a high proportion of frontline workers, immigrants, and monolingual families living in multi-generational households, the majority being Latinx.
Persons seeking testing provided demographics, symptoms and onset date, vaccination status, reason for testing and informed consent. There was no age restriction. Certified lab assistants collected bilateral anterior nasal swabs using manufacturer instructions. A second anterior nasal swab was immediately collected for RT-PCR. Certified readers read BinxNOW cards, and results were returned within an hour of testing using secure messaging in the Primary.Health platform. Photographed cards were re-read by a blinded trained expert, and these results were considered final for analyses. On January 9, we collected simultaneously anterior nasal swabs and oral cheek swabs on 75 persons randomly selected from persons seeking testing that day and tested for SARS CoV-2 with BinaxNOW and RT-PCR. Bilingual (Spanish and English) Unidos en Salud staff called persons diagnosed with COVID-19, offering supportive services including home deliveries of supplies, food, and care items as previously described (6). Persons who were eligible for COVID-19 treatment were referred to their primary health provider or Zuckerberg San Francisco General Hospital. Persons at risk with negative test results were advised to seek repeat rapid and/or RT-PCR testing.
RT-PCR using probes specific to N and E genes were performed on the nasal swabs collected in DNA/RNA Shield (Zymo Research) with an internal human positive control (RNAse P) as previously described (7). The assay limit of detection is 100 viral copies/mL; cycle thresholds less than 40 were considered positive. Using the same isolated RNA, allele specific RT-PCR was used to discriminate the two dominate lineages, omicron and delta, according to the manufacturer’s directions (8).
We calculated sensitivity and specificity of the rapid antigen tests, with RT-PCR as gold standard, both overall and using RT-PCR cycle thresholds (Ct) below 30 and 35 with the 731 specimens collected on January 3,4. 95% confidence intervals were calculated using the bootstrap method. We examined assay performance in strata defined by presence versus absence of symptoms at time of testing, age and vaccination status. We also calculated sensitivity and specificity of the rapid antigen tests, with RT-PCR as gold standard, both overall and using RT-PCR cycle thresholds (Ct) below 30 and 35 with the 75 nasal and oral cheek specimens collected on January 3,4.
Ethics Statement
The UCSF Committee on Human Research determined that the study met criteria for public health surveillance. All participants provided informed consent for dual testing.
Results
SARS-CoV-2 RT-PCR and BinaxNow testing was performed on 731 samples over a two-day period at our community testing site. Participants self-identified as 77.1% Latinx, 6.9% American, Central or South American Indian, 5.1% white, 3.2% Asian and 1.8% Black. There were 52.6% males and 47.4% females; 15.3% were under 12 years of age. Participants reported that the primary motivation for testing was clearance for work (26.1%), known or suspected exposure (23.1%), school requirement (17.8%), and due to symptoms (16.7%).
Overall, 296 of 731 (40.5%) persons of persons tested were SARS CoV-2 positive by RT-PCR. In a random sample of 184 samples, 66 samples, all with a Ct threshold of < 35, were consistent for omicron by allele specific PCR using (8), and 1 sample was consistent for the delta variant. Similar to performance with other variants, the BinaxNOW assay had its highest performance among persons with low Ct values.
There were 177 persons BinaxNOW positive among the 186 persons RT-PCR positive with Ct <30. There were no BinaxNOW positives among the 61 persons RT-PCR positive with Ct >35. (Figure 1). We calculated sensitivity of BinaxNOW within Ct threshold of < 30, < 35 and overall (i.e., no threshold) as 95.2% (95% CI 92-98%); 82.1% (95% CI 77-87%) and 65.2% (95% CI 60-70%), respectively (Table 1). BinaxNOW performance was similar among persons less than and greater than 12 years of age.
When stratified by symptom status, the BinaxNOW detected 53 of 59 RT-PCR positive persons who were asymptomatic for a sensitivity of 89.8% (95% CI 81-97%); sensitivity was 97.6% (95% CI 95-100%) for persons with symptoms. (Figure 1 and Table 1). We note that the BinaxNOW sensitivity was slightly lower but overlapping across strata of vaccination (Table 2). Specificity remained greater than 95% for all strata and Ct thresholds considered.
Of the simultaneous nasal and oral cheek specimens collected on 75 persons on January 9, 46/75 (61%) were positive on RT-PCR from the nares (Table 3),with 22 specimens yielding a Ct of less than 30. Among the 46 nasal RT-PCR positives, 22 were positive by BinaxNOW, while only 2 were positive from oral cheek specimens with BinaxNOW (4.3% sensitivity). Thirteen of the 46 RT positive nasal specimens were also positive on oral cheek RT-PCR. The sensitivity of the oral cheek specimens was only 9.0% for Ct threshold <30. There were no specimens RT-PCR positive from the oral cheek collection and negative on the nasal RT-PCR.
Discussion
Test positivity of omicron SARS CoV-2 infection was extremely high-40% RT-PCR prevalence-at a walk-up community testing site amidst the COVID-19 omicron surge in San Francisco. This cross-sectional analysis confirms that the BinaxNOW rapid antigen test detects omicron with a sensitivity similar to that observed for prior variants. The assay rapidly identifies persons with highest levels of virus, and thus those likely to pose the greatest risk for transmission at the time of the test (9). A positive rapid test enables immediate public health and personal action for isolation, disease mitigation, and clinical care, in a disease process where chains of transmission need to be broken and therapies are time-sensitive. With the increasing availability of this test in the United States, this information can inform optimal emerging public health strategies that hinge on rapid diagnosis and treatment.
Our data support the recommendation for repeat rapid antigen testing for persons at risk for COVID-19 who have an initial negative BinaxNOW result. Persons who have low levels of virus detectable on PCR but not antigen test may be either at the upswing or downswing of the viral dynamic curve for SARS CoV-2 (10). In the setting of an acute surge, it is likely than many persons are on the upswing, and may subsequently develop higher viral loads associated with greater infectiousness and detectable on repeat testing 1-2 days later.
Importantly, our data cannot inform an emerging question on whether throat swabs are an optimal specimen site for omicron detection in the non-hospital setting. Omicron putatively has a shorter incubation period than prior variants. Symptoms are more intense in the upper respiratory track, and the virus appears to be less pathogenic in the lower airway compared to prior variants (11). One small study with five positive health care workers suggested detection is faster from oral versus nasal swabs (12). Although we only examined 75 paired nasal and oral cheek swabs in cross sectional analyses, our data are compelling that that a simple oral swab does not increase detection of SARS CoV-2. BinaxNOW is not approved for use from other specimen collection sites, but examination of throat specimens based on emerging natural history data merits urgent attention.
Funding
Funding for this study was provided by UCSF, private donors, the Chan Zuckerberg Biohub, and the San Francisco Department of Public Health. The BinaxNOW cards were provided by the California Department of Public Health.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Footnotes
Conflict of Interest: Diane Havlir reports non-financial support for other projects from Gilead Sciences and Abbott
This revision incorporates additional data addressing the BinaxNOW performance from 75 oral samples.