SARS-CoV-2 seroassay optimization and performance in a population with high background reactivity in Mali

Serological tests are an indispensable tool to understand the epidemiology of the SARS-CoV-2 pandemic, particularly in areas where molecular diagnostics are limited. Poor assay performance may hinder the utility of these tests, including high rates of false-positivity previously reported in sub-Saharan Africa. From 312 Malian samples collected prior to 2020, we measured antibodies to the commonly tested SARS-CoV-2 antigens and four other betacoronaviruses by ELISA, and assessed functional cross-reactivity in a subset by SARS-CoV-2 pseudovirus neutralization assay. We then evaluated the performance of an ELISA developed in the US, using two-antigen SARS-CoV-2 spike protein and receptor-binding domain. To optimize test performance, we compared single and two-antigen approaches using existing assay cutoffs and population-specific cutoffs for Malian control samples (positive and negative). Background reactivity to SARS-CoV-2 antigens was common in pre-pandemic samples compared to US controls (43.4% (135/311) for spike protein, 22.8% (71/312) for RBD, and 33.9% (79/233) for nucleocapsid protein). SARS-CoV-2 reactivity correlated weakly with other betacoronavirus reactivity, varied between Malian communities, and increased with age. No pre-pandemic samples demonstrated functional activity. Regardless of the cutoffs applied, specificity improved using a two-antigen approach. Test performance was optimal using a two-antigen assay with population-specific cutoffs derived from ROC curve analysis [Sensitivity: 73.9% (51.6-89.8), Specificity: 99.4% (97.7-99.9)]. In the setting of high background reactivity, such as sub-Saharan Africa, SARS-CoV-2 serological assays need careful qualification is to characterize the epidemiology of disease, prevent unnecessary harm, and allocate resources for targeted control measures.


INTRODUCTION
Multiple serological tools have been developed to monitor SARS-CoV-2 spread during the COVID-19 pandemic. These tools are important to understand the epidemiology of disease through serosurveillance, particularly in areas where gold-standard molecular diagnostics are limited. To optimize test performance, serological tools may require adaptation for use in the target population and using locally available laboratory infrastructure. These issues disproportionately affect lower income nations, where reliable data are scarce and serosurveillance may be useful to direct the limited Public Health resources and to motivate equitable global vaccine distribution.
Serological assays that measure SARS-CoV-2 antibodies typically target one of three viral antigens: spike protein, nucleocapsid protein (NCP), or the receptor binding domain (RBD), a fragment of spike protein mediating viral adhesion [2,3]. Despite the large number of assays developed, the majority have not been qualified for use in populations where demographics and exposure histories differ significantly from the original assay validation population in high income countries. This is particularly relevant in sub-Saharan Africa, where high rates of false positivity have been described for many serological assays [4][5][6]. Recently, high rates of false positivity were reported using commercial SARS-CoV-2 serological assays in Benin, Tanzania and Zambia, conceivably due to cross-reactivity with other coronaviruses, or non-specific polyclonal reactivity that may be associated with unrelated conditions, including malaria [7,8].
False positive tests may cause unnecessary alarm and harm at an individual and population level.
As a result, in the setting of background reactivity, particular attention must be given to test specificity. Specificity may be improved by adjusting thresholds for seropositivity or by testing for antibodies to multiple SARS-CoV-2 antigens, as currently recommended by the US FDA, particularly in low-prevalence settings [9].
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021. ; https://doi.org/10.1101/2021.03.08.21252784 doi: medRxiv preprint To understand and optimize the performance of serological tools for population serosurveillance in Mali, we evaluated pre-pandemic samples collected from Malian cohorts prior to 2020 for background reactivity to the commonly tested SARS-CoV-2 antigens, cross-recognition with other betacoronaviruses, and in vitro SARS-CoV-2 pseudovirus neutralizing activity. We subsequently evaluated the performance of an assay developed in the US using a Malian negative control (pre-pandemic) and positive control (convalescent) samples. Finally, we optimized assay performance by comparing single and dual antigen approaches and establishing Malian population-specific cutoffs.

Plasma Samples
Pre-pandemic negative control plasma samples collected from Malian individuals (n=312) were obtained from ongoing studies at four MRTC sites with a strong history of community engagement in malaria research conducted in collaboration with NIAID/NIH (NCT02942277, NCT03952650, NCT03989102, NCT01322581). The four geographically distinct contributing sites were Sotuba, an urban center study population of healthy adults in urban Bamako; Bancoumana, a rural study population of healthy adults located along a major road transport route between Mali and Guinea; Ouelessebougou, a rural study population of women in their childbearing years located along a major road transport route between Mali and two neighboring countries, Burkina Faso and Cote d'Ivoire; and Kalifabougou, a rural study population of all ages. Rural centers experience high rates of seasonal malaria infection. All samples were collected prior to 2020.
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021

Defining SARS-CoV-2 antigen background reactivity Malian samples
To identify the most suitable SARS-CoV-2 antigens for population serosurveillance in Mali, we examined pre-existing reactivity to SARS-CoV antigens and to antigens of other coronaviruses in the negative control samples from Mali. Provisional thresholds for positivity were established for each antigen from a small cohort of pre-pandemic US samples (n=20), calculated as the mean plus three standard deviations of these results.
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. Negative control samples were tested by ELISA at LMIV/NIAID, Bethesda, for antibodies to SARS-COV-2 spike protein, RBD and NCP, and the spike proteins of SARS-CoV-1, MERS-CoV, OC43 and HKU1 (Table 1). Data were assessed by site and by age group to understand possible demographic and geographic factors affecting antigen reactivity. Potential crossrecognition between SARS-CoV-2 and other betacoronavirus spike antigens was examined by linear correlation. Functional activity of reactive antibodies in a subset of samples was assessed by pseudovirus neutralization assay.
Nucleocapsid protein (GenBank: QHD43423.2, amino acids 1-419) was synthesized and cloned (GenScript) into the AgeI and KpnI sites in the expression vector pHLSEC [13]. Endotoxin free plasmid used for nucleocapsid protein production was generated using a high-speed maxi prep kit (Qiagen) and the protein was produced in the Expi293 cell line (Thermo Fisher). Typically, Expi293 suspension cells in Expi293 Expression medium (Thermo Fisher) were grown at 37°C and 8% CO2, maintaining cultures at continuous log phase growth (3.0-5x10 6 ) for 3-4 passages after thawing. The day before transfection, 500 mL of culture was seeded at a density of 2.5-3x10 6 cells/mL in a 2 L flask. The day of transfection, cells were diluted back to 2.5-3x10 6 prior to transfection. Expi293 cells were transfected using 1.4 mL of ExpiFectamine (Thermo Fisher) and 0.5 mg of plasmid DNA per 0.5 L of cells. Plasmid DNA was diluted into 25 mL of for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. OptiMEM (Thermo Fisher) and filter sterilized through a 0.2 micron filter. The ExpiFectamine was slowly added to 25 mL of OptiMEM, gently mixed and incubated for 5 min. The diluted ExpiFectamine was then added slowly to the diluted DNA, gently mixed and incubated at RT for 10-20 min. The mixture was added to the cells slowly while swirling the flask. The flask was returned to the incubator at 37°C and 8% CO2 for 16-20 hrs. The following day, both enhancer I and II (Thermo Fisher) were added to the Expi293 cultures and returned to the incubator.
Cultures at 4 days post-transfection were centrifuged at 10,000 x g for 30 min. The spent culture media was sequentially filtered through 0.45 µm and 0.2 µm filters. The clarified spent media was loaded on a 5 mL HisTrap Excel NTA column (GE Life Sciences). The column was washed with 20 column volumes of wash buffer (20 mM sodium phosphate, 0.5 M NaCl, 0 to 30 mM imidazole, pH 7.4). The bound protein was eluted with a step gradient of elution buffer (20 mM sodium phosphate, 0.5 M NaCl, 500 mM imidazole, pH 7.4). The eluted NTA fractions were confirmed to contain nucleocapsid protein by SDS-PAGE (4-12% Bis-tris, Thermo Fisher) and Coomassie staining. The fractions were pooled, concentrated, and buffer exchanged by diafiltration using a 10 kDa cutoff centrifugal filter unit (Millipore Sigma). The absorbance at 280 nm was determined and the concentration of the recombinant nucleocapsid protein was calculated from the predicted extinction coefficient from the protein sequence. Proteins were then aliquoted and stored at -80°C.

Enzyme-Linked Immunosorbent Assay
As MRTC has significant expertise performing ELISAs and local infrastructure supports this platform, the semi-automated two-antigen ELISA developed at NIBIB/NIH [14] was selected for transfer from the US to Mali. Preliminary process qualification was conducted at LMIV/NIAID, Bethesda prior to transfer and validation of the assay at the MRTC/DEAP Immunology Laboratory in Bamako, Mali.
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. ELISAs were performed as previously described [12,14]. In brief, 100 µL of antigen suspension in 1xPBS was added to each well of a 96-well Immulon 4 HBX ELISA plate and allowed to coat overnight at 4°C for 16 hours. Antigen suspension concentrations were SARS-CoV-2 spike protein 1 µg/mL; RBD 2 µg/mL; NCP 1 µg/mL; and other betacoronavirus spike proteins 1 µg/mL. Wells were washed three times with 300 µL of 1xPBS + 0.05% Tween20 by automatic plate washer followed by blocking for 2 hours at room temperature with 200 µL of 1x PBS + 0.05% Tween20 + 5% nonfat skim milk. After blocking, wells were washed again three times.
Heat inactivated plasma samples were diluted at 1:400 in blocking buffer and 100 µL of sample added to wells. Positive, negative, and blank controls were included on all plates. Positive controls were monoclonal antibody dilutions of the neutralizing antibody CR3022 (10 µL of 500, 250, 125, 62.5, 31.3 ng/mL, LMIV internal construct). Negative controls were pooled prepandemic plasma from Malian children diluted and added to wells as for samples. All samples and controls were run in duplicate. Samples were incubated for 1 hour at room temperature, then washed three times with 300 µL of wash buffer. One hundred (100) microliters of goat anti-Human IgG (H+L) Cross-Adsorbed secondary antibody, HRP (ThermooFisher) diluted at 1:4000 in blocking buffer was added to wells, incubated for 1 hour at room temperature, then washed three times with 300 µL of wash buffer. One hundred (100) microliters of 1-Step Ultra TMB Substrate (ThermoFisher) was added and the plate was incubated for 10 minutes prior to the addition of 1N sulfuric acid stop solution (ThermoFisher). Absorbance was read at 450 nm and 650 nm on the Spectramax M3 microplate reader (Molecular Devices, US). Absorbance values (optical density, OD) were collected at 450 and 650 nm. A650 was subtracted from A450 to remove background signal.
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.  The pseudotyped virus-sample mixture was incubated at 37°C for one hour in 9% CO2. Forty thousand BHK21-ACE2 cells dissociated with 0.5% Trypsin EDTA, no-phenol red (Gibco), and diluted in DPBS (Gibco) were transferred to each well of a new non-tissue culture treated polypropylene 96 round-bottom well plate (Corning). The DPBS was gently aspirated after one round of centrifugation at 2,000 RPM for five minutes. Seventy microliters of pseudovirussample mixture was immediately added to wells containing BHK21-ACE2 cells and incubated overnight at 37°C in 9% CO2. Following incubation, cells were sedimented by centrifugation at 2,000 RPM for five minutes. The pseudovirus-sample mixture was gently aspirated and 10 µL of 0.5% Trypsin EDTA, no-phenol red (Gibco) was added and incubated with cells for two minutes at room temperature. Cells were resuspended in 100 µL HBSS (Gibco) supplemented with 0.1% BSA. Samples were analyzed using a BD Celesta instrument employing a high throughput system unit. We performed the analysis performed using FlowJo software (TreeStar). The frequencies of EGFP-positive cells were normalized by the non-Ab-treated samples and fitted to for use under a CC0 license.
This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

BHK-21-ACE2 cell production
The BHK-21 cell line was maintained in DMEM (Gibco, 10566016) supplemented with 10% FBS, grown at 37°C, 9% CO2 humid atmosphere and tested mycoplasma-negative using This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021. designated further as SB100X. BHK-21 cells were seeded at 5 x 10 5 cells/ml density in a 60 mm tissue-culture-treated dish in a total volume of 4 mL complete media 24 hours prior transfection.
Plasmids pSBbi-BH hACE2 and SB100X were co-transfected in a molar ratio of 10:1 using

VSVdG-EGFP-SARS2-Sgp virus production
To generate non-replicative self-reporting VSVdG-EGFP-SARS2-Sgp, we employed a commercial VSVdG system (Kerafast). Briefly, a T75 tissue flask was seeded with five to seven for use under a CC0 license.
This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021. ; https://doi.org/10.1101/2021.03.08.21252784 doi: medRxiv preprint inverse value of inoculum volume (0.1 mL). The average of three data points from an unsaturated fraction of the titration curve was calculated as the titer.
To generate VSVdG-EGFP-SARS2-Sgp, a T75 tissue flask was seeded with eight million BHK21-SARS2-Sgp-CTd16aa cells in DMEM (Gibco) supplemented with 8% FBS (Hyclone) and 10 mM HEPES (Corning). VSVdG-EGFP-Gp P3 aliquots were thawed on ice and diluted in This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

Assessing performance of US cutoffs in Malian samples
The NIBIB ELISA-based serology assay was transferred for use at the MRTC/DEAP Immunology Laboratory, Bamako. This is a two-antigen assay to detect antibodies to SARS-CoV-2 spike protein and RBD, developed for use in US population serosurveillance studies [14].
A positive test requires reactivity to both antigens above cutoffs developed in the US population.
To assess the performance of US cutoffs in the Malian population, we calculated the test characteristics using Malian negative (n=311) and positive control samples (n=23). The sensitivity, specificity, and positive predictive value across a range of plausible population seroprevalences of the US cutoffs was calculated.

Optimizing assay performance for use in Mali
To evaluate different methods to improve assay performance, single-and two-antigen approaches were assessed using population-specific cutoffs. Population-specific cutoffs were developed using two methods. Firstly, arithmetic thresholds of two, three, and four standard deviations above the mean of the negative control cohort were calculated for each antigen. This approach was used in the original development of the assay for use in the US population [14].
Secondly, thresholds for spike and RBD were developed by interrogating ROC curves generated from the positive and negative control cohorts. Test performance characteristics of these population-specific cutoffs were calculated as for the US cutoffs.
for use under a CC0 license.
This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

Data analysis
Data were analyzed using Microsoft Excel and GraphPad Prism7 software. In pre-pandemic Malian samples, the coefficient of variation for SARS-CoV-2 antigen assay absorbance values was calculated to assess variability in background reactivity in this population. Assay absorbance values for SARS-CoV-2 antigens and other betacoronavirus spike proteins were compared between demographic groups using Kruskal-Wallis tests. No adjustments have been made for multiple comparisons. Linear correlation between assay absorbance values for viral antigens and assay absorbance and neutralizing activity was assessed by Pearson correlation, as previously described [12]. Correlations were classed as negligible r<0.3, weak 0.3<r<0.5, moderate 0.5<r<0.7, or strong >0.7 [16]. Provisional test cutoffs were derived from the mean plus two, three, or four standard deviations of results from the negative control cohort, and manually interrogating the inflection points of ROC curves generated using the results of the negative and positive control cohorts. Measures of test performance are presented with 95% confidence intervals.

Pre-pandemic reactivity to SARS-CoV-2 and other coronaviruses in Mali
Negative control samples collected from four study sites between 2017 and 2019 were tested for antibodies to SARS-COV-2 spike protein (n=312), RBD (n=311) and NCP (n=233) and the spike proteins of SARS-CoV-1, MERS-CoV, OC43 and HKU1 (n=248) ( Table 1). Some sample volumes were insufficient to test all antigens.
Many Malian samples demonstrated marked reactivity to the SARS-CoV-2 antigens commonly used in clinical serological tests relative to provisional thresholds derived from a small cohort of pre-pandemic US samples (n=20) (Figure 1). Background reactivity in Malian samples exceeded for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. 148.2% and NCP 109.2%. This degree of pre-existing reactivity was thought likely to affect the effectiveness of serosurveillance. As a result, the characteristics of samples with high background reactivity were examined further. Due to limitations in sample volume, some samples were not able to undergo all antibody This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021.  (Table 1). In samples from the Kalifabougou site that included children and adults (n=100), reactivity to all SARS-CoV-2 antigens increased with age group (Kruskal-Wallis test, p<0.0001 for spike protein, RBD, and NCP; Figure 2E-G).
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.  This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.   This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. Although the patterns of site and age-related reactivity were similar for SARS-CoV-2 antigens and other betacoronavirus spike proteins, linear correlations in assay absorbance values were modest ( Figure 3). In contrast, a strong correlation was observed between the common cold betacoronaviruses OC43 and HKU1 (Pearson r=0.728, p<0.0001) which share a high degree of sequence homology and may elicit serological cross-reactivity [12,17]. SARS-CoV-2 spike and RBD reactivity correlated minimally (Pearson r=0.217, p=0.0006), despite RBD being a subunit of the whole spike protein.
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.   This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

Assessing performance of US cutoffs in Malian samples
To establish the clinical effect of high background reactivity, we evaluated the performance of the NIBIB two-antigen ELISA in Malian negative control samples (n=311, four geographically distinct sites, all ages) and positive control samples (n=23, Bamako, adults) ( Table 1,   Supplementary Table 1). Using the assay approach and cutoffs developed in the US population, test sensitivity was 78.3% (95% CI: 56.3-92.5) and specificity was 97.4% (95% CI: 95.0-98.9) in Malian samples ( Figure 5).
In the negative control cohort, 8/311 (2.6%) were considered seropositive (assay absorbance signal above threshold for both spike protein and RBD). Single antigen reactivity to spike protein for use under a CC0 license.
This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
In the positive control cohort, 18/23 (78.3%) were seropositive for both spike protein and RBD.
This represented a modest reduction in sensitivity compared to a single antigen approach, where reactivity to spike protein alone was observed in 19/23 (82.6%) and RBD alone in 19/23 (82.6%). All subjects were adults, and the time between diagnosis by PCR and sample collection for ELISA ranged between 27 to 270 days (Supplementary Table 1). Almost half of subjects (10/23) were asymptomatic or paucisymptomatic (reporting a single symptom). Disease severity ranged from asymptomatic to critical using WHO stratification criteria [18]. Lower reactivities to spike and RBD were associated moreso with milder disease severity, rather than increased time since diagnosis (Supplementary Figure 3). This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.  The positive predictive value of the existing assay was estimated across a range of plausible community seroprevalences. At a lower hypothetical seroprevalence of 1% the positive predictive value (PPV) was 23.5% (95% CI: 13.0-38.6) at 5% the PPV was 61.6% (95% CI: 43.9-76.6) and at 10% the PPV was 77.2% (62. 3-87.4). As a result, the existing assay approach and cutoffs were not considered suitable to confidently estimate the burden of exposure in a community with limited molecular diagnostic data and an uncertain pre-test probability. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

Optimizing assay performance for use in Mali
We sought to improve test performance to better suit the Malian population. To optimize the assay, the performance of single-and two-antigen approaches was assessed using populationspecific cutoffs. Population-specific cutoffs were developed using two methods. Firstly, arithmetic thresholds of two, three, and four standard deviations above the mean of the negative control cohort were calculated for each antigen. Secondly, thresholds for spike and RBD were developed by interrogating ROC curves generated for each antigen from the positive and negative control cohorts. The performance characteristics of these population-specific cutoffs were estimated in the existing cohorts ( Table 2). As expected, arithmetic cutoffs improved assay specificity however this was at the expense of sensitivity. In contrast, ROC curve analysis cutoffs delivered a sensitivity of 73.9% (95% CI: 51.6-89.8) and specificity of 99.4% (95% CI: 97.7-99.9), representing an improvement on the assay cutoffs developed in a US population with a minimal loss in sensitivity. At a lower hypothetical seroprevalence of 1% the PPV was 53.7% (22.2-82.5), at 5% the PPV was 85.8% (59.8-96.1) and at 10% the PPV was 92.7% (75.9-98.1).

DISCUSSION
If serological surveillance is to be a useful tool to aid the Public Health response to the COVID-19 pandemic, test selection and validation in the target population will be critical. Our findings highlight the need for care in SARS-CoV-2 assay selection and interpretation, and the challenge of assay implementation in sub-Saharan Africa.
Background reactivity to SARS-CoV-2 antigens was common. This reactivity varies geographically and may be in part related to prior coronavirus exposure; however other cumulative exposures and non-specific binding may also exert an effect. In the negative control cohort, reactivity to the common cold betacoronaviruses OC43 and HKU1 was common.
Although MERS-CoV is thought to circulate in camel populations in Northern Mali [19] reactivity to MERS-CoV spike protein was similar to that observed for SARS-CoV-1 and SARS-CoV-2, suggesting that there is limited MERS-CoV exposure in our population. As a result, in our cohort, exposure to common cold betacoronaviruses is more likely to explain any betacoronavirus-related SARS-CoV-2 antigen cross-reactivity, rather than exposure to MERS-CoV or SARS-CoV-1. Nonetheless, we are unable to exclude the contribution of other coronaviruses, including undescribed animal coronaviruses in Mali. While cross-recognition between SARS-CoV-1 and MERS-CoV may result in SARS-CoV-2 cross-reactivity, common cold coronaviruses and SARS-CoV-2 spike are thought to have minimal cross-reactivity [12,17].
Given the modest correlation with other betacoronavirus reactivity, it is likely that other cumulative exposures and non-specific binding contribute to SARS-CoV-2 antigen background reactivity. While understanding the cause of non-specific reactivity is less important than quantifying this reactivity, the effect of seasonal malaria warrants future assessment as it is for use under a CC0 license.
This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021. ; https://doi.org/10.1101/2021.03.08.21252784 doi: medRxiv preprint particularly relevant in Mali. This study did not examine changes over time in the same community or assess the effect of acute malaria on SARS-CoV-2 antigen reactivity.
Although pre-existing immunity has been hypothesized as a potential explanation for the comparatively benign course of the COVID-19 pandemic in parts of sub-Saharan Africa [20,21], we did not identify functional antibodies in Malian samples with reactivity to SARS-CoV-2 antigens. While differences in environmental exposure history and in immune response to viral challenge compared to European and North American populations may contribute to differences in diagnostic test performance and pandemic epidemiology in sub-Saharan Africa, pre-existing circulating functional antibodies were not apparent in Malian samples.
Due to high background reactivity in Malian samples, testing of a single SARS-CoV-2 antigen is unlikely to offer sufficient specificity for use in serosurveillance unless very high thresholds for positivity are applied. To overcome this high background reactivity, a two-antigen approach is more appropriate. In Mali, SARS-CoV-2 spike protein and RBD appear to be superior targets compared to NCP for such an approach. This was due to the potential for correlation with neutralizing activity [22,23], the higher background reactivity absorbance values observed in NCP ELISA of COVID-19 naïve Malian samples, and the lower specificity of NCP as an antigen reported in other populations [24][25][26].
Optimizing specificity was considered the primary objective of assay adaptation, however the tradeoff with sensitivity required consideration due to the pronounced overlap between positive and negative control cohorts. The relatively low seropositivity irrespective of the cutoffs applied to the positive control cohort may be related to the mild nature of most cases included (17% asymptomatic, 57% mild, 9% moderate-severe, 13% critical based on WHO stratification criteria for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.
The copyright holder for this preprint this version posted March 12, 2021. ; https://doi.org/10.1101/2021.03.08.21252784 doi: medRxiv preprint [18]). The relatively long time since PCR-confirmation (median: 181 days, range: 27-270) did not appear to be clearly related to antigen reactivity, in contrast to other reports [27]. Although use of such a positive control cohort adversely affects the apparent performance of the test, this combination of low-acuity illnesses and variable time since infection is likely to be reflective of a community serosurveillance sample and the sensitivity of the test was considered acceptable for population use. Further qualification in a larger group of confirmed Malian COVID-19 cases is planned.
While a threshold of three or four standard deviations above the mean of the negative control cohort is commonly used to establish specific preliminary cutoffs in single antigen assays, these cutoffs are prohibitively high in Mali and do not achieve a test performance appropriate for community serosurveillance. Furthermore, a threshold of two standard deviations above the mean of the negative control cohort, which was considered the optimal method in the US population [14], similarly reduced assay sensitivity to nearly 50% when using a two-antigen approach. In contrast, applying population-specific cutoffs derived from interrogation of ROC curves generated from local positive and negative control cohorts was able to improve test performance.
This methodical evaluation of serological assay options and the adaptation of approaches for use in Mali have yielded an optimized test that is well-validated and makes use of existing laboratory infrastructure. While increased background reactivity to SARS-CoV-2 antigens must be acknowledged, this reactivity may be largely offset through the use of a two-antigen assay and adaptation of assay cutoffs to suit the local population. Although the test characteristics remain imperfect, a thorough understanding of test performance will provide reassurance for estimates in future community serosurveillance.
for use under a CC0 license. This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.  This article is a US Government work. It is not subject to copyright under 17 USC 105 and is also made available (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.