Abstract
COVID-19 convalescent plasma (CCP) received approval for use under an Emergency Use Authorization by the FDA for treatment of seriously ill patients. Use of CCP units with a signal-to-cutoff ratio of ≥12 using the Ortho VITROS SARS-CoV-2 IgG test (OVSARS2IgG) is authorized. Little is known about the relationship between this ratio and the neutralizing capacity of plasma/sera against genuine SARS-CoV-2 virus. We measured the neutralizing capacity of 981 samples from 196 CCP donors 7-119 days post initial donation (DPID). Neutralizing capacity was assessed for 50% (PRNT50) and 90% (PRNT90) reduction of infectious virus using the gold standard plaque reduction neutralization test (PRNT). Importantly, while 32.7%/79.5% (PRNT90/PRNT50) of donations met the FDA minimum titer of 1:80 initially, only 14.0%/48.8% (PRNT90/PRNT50) met this cut-off ≥85 DPID. A subset of 91 donations were evaluated using the OVSARS2IgG and compared to PRNT titers for diagnostic accuracy. The correlation of OVSARS2IgG results to neutralizing capacity allowed extrapolation to CCP therapy efficacy results. CCP with OVSARS2IgG ratios in the therapeutically beneficial group had neutralizing titers of ≥1:640 (PRNT50) and/or ≥1:80 (PRNT90). This information provides a new basis for refining the recommended properties of CCP that is used to treat severe COVID-19.
Introduction
The emergence of COVID-19 disease, caused by infection with the SARS-CoV-2 virus, has precipitated a global public health crisis. Treatment of COVID-19 primarily consists of supportive care, although several experimental therapies are being tested in clinical trials. Convalescent plasma has long been used as a therapeutic for viral infections when other effective drugs or therapies are absent and has been used to treat SARS infections (1, 2). To date, more than 84,000 patients in the United States have been transfused with COVID-19 convalescent plasma (CCP) (3). The efficacy of CCP has been difficult to establish, but it is thought that CCP has an acceptable safety profile and may provide therapeutic benefit (4-8).
Protective correlates of immunity have not been definitively established for COVID-19, but vaccine trials in non-human primates have shown correlation between neutralizing antibody response and protection from SARS-CoV-2 challenge (9, 10). Thus, the potential therapeutic benefit of CCP is thought to be dependent on the ability of antibodies present in the plasma to neutralize SARS-CoV-2 and block infection. Neutralizing antibodies from recovered COVID-19 patients compete with angiotensin-converting enzyme 2 for binding of receptor binding domain (RBD) on the trimeric spike protein of SARS-CoV-2 (11). Several serological assays have been developed to measure the binding of antibodies in sera/plasma to a variety of SARS-CoV-2 spike antigens, including RBD, the S1 subunit of spike, and trimeric conformations of the spike ectodomain (12, 13). An absolute neutralizing titer associated with therapeutically beneficial CCP has been difficult to elucidate, as many larger published studies characterized none or few of the CCP units for neutralizing titer with live SARS-CoV-2 virus (5, 7, 8). Instead, serological assays that measure the titer of anti-RBD or anti-spike antibodies have served as surrogates, and a lack of widely available standardized reagents and control sera make direct comparison across labs difficult. Several different titers have been recommended after comparison of customized ELISA-based assays to varied microneutralization assays that use SARS-CoV-2 virus, but the relationship between these assays and the neutralizing capacity of sera/plasma as measured by the gold standard plaque reduction neutralization test (PRNT) is not always clear (12-14). This point becomes particularly crucial when selecting CCP with the highest neutralizing capacity and/or avoiding the transfusion of units of CCP with little/no neutralizing capacity (15). Recently, the U.S. Food and Drug Administration (FDA) declared that units of CCP can be qualified as high titer if they have a signal-to-cutoff ratio of ≥12 using the Ortho VITROS SARS-CoV-2 IgG test (OVSARS2IgG) (16). Like other surrogate neutralization assays, the OVSARS2IgG measures antibody binding to the SARS-CoV-2 S1 antigen. A single report has shown concordance between OVSARS2IgG ratios and pseudovirus neutralization, but this test has not been compared to PRNT using genuine SARS-CoV-2 (17).
Symptom severity has been reported to positively correlate with neutralizing capacity convalescent COVID-19 patients, as does male gender and age (18, 19). It has been suggested that these criteria can be used to select the CCP donors most likely to contribute CCP with high neutralizing capacity. However, a specific optimal window post symptom resolution for CCP collection has not been defined (18). There is debate about the stability of neutralizing antibody responses in recovered COVID-19 patients, with conflicting results from different studies. Prior studies lacked serial specimens from the same individual, completed analyses on a small number of serial specimens within a limited time frame, or did not assess neutralizing capacity of paired specimens (14, 19-21). There is great interest in understanding the durability of neutralizing antibody responses in convalescent COVID-19 patients, as there is concern that rapid decay in neutralizing capacity could result in susceptibility to re-infection with SARS-CoV-2. Additionally, significant decreases in the neutralizing antibody capacity of convalescent COVID-19 patients would render time post symptom resolution a critical factor in CCP donor selection.
The goals of this study are to characterize the neutralizing capacity of serial donations of CCP using PRNT with genuine SARS-CoV-2, to evaluate the CCP-qualifying criteria of the OVSARS2IgG test at different levels of neutralizing capacity, and to correlate PRNT titer and OVSARS2IgG ratios to data on the therapeutic efficacy of CCP compiled by the Mayo Clinic/US EAP COVID-19 Plasma Consortium (US-EAP-CPC).
Results and Discussion
The durability of the neutralizing capacity of CCP donors
Of the 981 specimens analyzed ranging up to 119 DPID, 61.1% were contributed by males, 38.4% were contributed by females, and 0.5% were contributed by individuals that did not specify gender. Specimens contributed by males had significantly greater mean neutralizing capacities (P value <0.0001) than those contributed by females. The mean age of the study population was 48 years. Age was weakly, positively correlated with neutralizing titer (PRNT50 Spearman r 0.2129, P value <0.0001; PRNT90 Spearman r 0.1988, P value <0.0001). Neutralizing antibodies were not detected in 1.3% of CCP tested at the minimum dilution (1:20) screened in this study. As a population, 25.8% (PRNT90) to 73.0% (PRNT50) of donations had a PRNT titer of ≥1:80. Comparatively, 9.5% (PRNT90) to 51.4% (PRNT50) of all donations had a PRNT titer of ≥1:160.
Neutralizing capacities of donations were compared in two-week intervals at the PRNT50 (Table 1) and PRNT90 levels (Supplemental Table 1). The proportion of specimens that meet the FDA minimal 1:80 and recommended 1:160 cut-offs decreased over time at both levels of neutralization. A significant proportion (23.4%) of donations decreased ≥4-fold in PRNT50 titer, while fewer (8.5%) had a decreased PRNT90 titer versus their initial draw (Supplemental Table 2 and 3). Mean PRNT50 neutralizing titers decreased significantly over time (P <0.0001) (Figure 1A and B). The most significant decreases in PRNT50 titer occurred at ≥43 DPID, suggesting a 6-week window, likely corresponding to 3 -9 weeks post symptom onset, is optimal for maximizing collection of high titer CCP. While the decrease in PRNT90 neutralizing titers was not statistically significant (P= 0.0661) (Supplemental Figure 1A and B), all donors with titers ≥1:320 experienced decreases in PRNT90 titer by their final draw (Supplemental Figure 1B). While 9.2% (18/196) of CCP donors converted from positive to negative for neutralizing activity at the PRNT90 level, none of the donors converted from positive to negative for neutralizing activity at the PRNT50 level at any time point. Loss of neutralizing capacity at PRNT90 level occurred at ≥61 DPID for 15 of 18 donors. While low a PRNT50 titer may render a unit of CCP undesirable for use as a COVID-19 therapeutic, these results suggest that individuals that produce neutralizing antibody retain some SARS-CoV-2 neutralizing capacity for up to 119 DPID.
Ortho VITROS SARS-CoV-2 IgG test and neutralizing capacity of sera
A subset of specimens was evaluated using the FDA-approved OVSARS2IgG test at FDA and Mayo Clinic/US-EAP-CPC derived cut-offs. The OVSARS2IgG ratios of sera from initial draws were compared to the OVSARS2IgG ratios of a subsequent draw where neutralizing titer remained constant or decreased. While most sera pairs with decreases in neutralizing capacity also had decreases in OVSARS2IgG ratios, the difference was not statistically significant (Figure 1C). Sera with less than FDA mandated OVSARS2IgG ratio (<12) had significantly lower PRNT50 and PRNT90 titers than sera with a ratio ≥12 (Figure 2A and D). Next, the distribution of PRNT titers was analyzed according to the OVSARS2IgG ratio ranges used by the Mayo Clinic/US-EAP-CPC in a recent report on the efficacy of CCP (5). The PRNT50 and PRNT90 titers of sera with an OVSARS2IgG ratio >18.45 were significantly higher than those with ratios <4.62 or 4.62-18.45 (Figure 2B and E). The samples analyzed include an approximate representation of the distribution of neutralizing titers of the larger study population, but performance characteristics could be altered if a greater proportion of specimens with very high or very low neutralizing titers were assayed instead.
The accuracy of the OVSARS2IgG test to qualify high titer CCP was compared to the reference standard PRNT at both levels of neutralizing capacity. The FDA-established OVSARS2IgG ratio of ≥12 and the Mayo Clinic/US-EAP-CPC derived ratio of >18.45 were used in the performance assessment. The ability of the OVSARS2IgG test to correctly identify sera with any neutralizing capacity (inverse of the neutralizing titer (NT) NT≥20), or those with titers at the FDA recommended levels (NT≥80 or NT≥160) at the PRNT50 (Table 2) and PRNT90 levels was determined (Supplemental Table 4). The FDA cut-off of 12 resulted in 100% specificity and positive predictive value for NT≥20 and NT≥80 at the PRNT50 level. Sensitivity and negative predictive value improved when capturing specimens with NT≥80 or NT≥160 compared to NT≥20 at the PRNT50 level.
CCP with an OVSARS2IgG ratio >18.45 significantly correlates with improved outcomes in patients transfused shortly after hospitalization (5). While our results support the use of an OVSARS2IgG ratio ≥12 to exclude CCP with no neutralizing capacity from therapeutic use, we determined whether an OVSARS2IgG ratio >18.45 provided additional discriminatory power. Significantly, the >18.45 cut-off had improved specificity and positive predictive value for specimens with NT≥160 (Table 2). It also had better specificity and positive predictive value than a cut-off of ≥12 for specimens with a NT≥20 or NT≥80 at the PRNT90 level (Supplemental Table 4). The mean PRNT50 titer of the >18.45 group is 1:523.5 (mode >1:640), while the mean PRNT90 titer is 1:190.4 (mode 1:80) (Figure 2B and E). Analysis of the distribution of neutralizing titers compared to the OVSARS2IgG ratios and the ranges associated with efficacy by the Mayo Clinic/US-EAP-CPC revealed that sera with the highest neutralizing capacity have OVSARS2IgG ratios that are significantly higher than sera with low neutralizing capacity (Figure 2 C and F). These direct comparisons between the neutralizing capacity of sera, their corresponding OVSARS2IgG ratios, and the patient outcome data released by the Mayo Clinic/US-EAP-CPC support updating recommendations for CCP use to specify that a PRNT90 titer ≥1:80 and/or a PRNT50 titer ≥1:640 qualify as high titer CCP.
The analysis presented herein clarifies the functional relationships between live SARS-CoV-2 virus neutralizing titers and the only current FDA approved surrogate neutralization test for qualifying CCP. While an OVSARS2IgG test ratio ≥12 excluded all tested specimens with a NT<20 at the PRNT50 level, this ratio does not exclude specimens with low neutralizing capacity and uncertain therapeutic efficacy from being labeled high titer CCP. Rather, high titer CCP donations are better characterized by an OVSARS2IgG test ratio >18.45, which maximizes specificity and positive predictive value at both levels of neutralizing capacity measured. This recommendation is supported by our observation that CCP in a therapeutically beneficial treatment group is most likely to have PRNT90 titer ≥1:80 and/or a PRNT50 titer ≥1:640. Along with previously established guidelines for donor selection (18), consideration of time since disease resolution will further refine donor selection to yield high titer CCP, particularly when CCP donations cannot be tested for their neutralizing capacity using live SARS-CoV-2.
Methods
Study Specimens
Specimens were collected from individuals who met all FDA donor eligibility requirements (21CFR 630.10 and 21 CFR 630.15) and qualifications in accordance with the guidelines of the New York Blood Center (NYBC). Donors were required to present documentation of a positive SARS-CoV-2 PCR diagnostic test or positive serologic test after recovery and to have been symptom free for at least two weeks. Donors contributed CCP/sera at will, with a minimum of 7 days between serial contributions. Specimens were stored at -20°C until tested. Testing at the Wadsworth Center was done under protocol 20-021 with approval from the NYSDOH Institutional Review Board.
PRNT Analysis
Participants were selected at random from a de-identified list of residual clinical specimens submitted for anti-SARS-CoV-2 antibody testing at the Wadsworth Center Laboratory. Groups of donors with varying intervals between initial donation and final donation were retrospectively selected for study: 14-35d (n=45), 36-60d (n=27), 61-75d (n=55), and >75 (n=69). Sample selection and testing was blinded to clinical data including age, gender, and SARS-CoV-2 antibody test results from the Wadsworth Center clinical assay.
PRNT analysis was conducted by mixing 100 ul of 200 PFUs of SARS-CoV-2, isolate USA-WA1/2020 (BEI Resources, NR181 52281) with 100 ul of 2-fold serially diluted test sera and incubated at 37°C in 5% CO2 for one hour. Confluent Vero E6 cells (C1008, ATCC CRL-1586) seeded in 6 well plates were inoculated with 100 ul of the virus:serum mixture and adsorption proceeded for one hour at 37°C in 5% CO2. A 0.6% agar overlay prepared in maintenance medium (Eagle’s Minimal Essential Medium, 2% heat-inactivated FBS, 100 µg/ml Penicillin G, 100 U/ml Streptomycin) was added after adsorption and the assay was incubated at 37°C in 5% CO2. A second agar overlay with 0.2% Neutral red added was added two days post infection. After an additional day of incubation, the number of plaques in each well were recorded. The titer was reported as the inverse of the highest dilutions of sera providing 50% (PRNT50) or 90% (PRNT90) viral plaque reduction relative to virus-only infection. Normal human serum was used as a negative control and previously characterized COVID-19 patient sera was used as a positive control in each assay.
Ortho VITROS SARS-CoV-2 IgG testing
A subset of ∼10% of donor sera was selected for analysis using the Ortho VITROS SARS-CoV-2 IgG test (OVSARS2IgG). Specimens with missing/indeterminate PRNT titers were excluded from analysis. The subset was selected so it approximated the total study population with regards to neutralization at/above the FDA minimal 1:80 titer at the PRNT50 level (total study population = 73%, subset = 68.1%). Additionally, the subset included 11 matched pairs with steady PRNT titers and 21 matched pairs with decreases in PRNT titers (late versus early donation). Two selected donations had insufficient volume for testing, so were replaced with specimens with equivalent titers selected at random from NYBC specimens subjected to PRNT. DPID ranged from 0-114d for the subset. The OVSARS2IgG test was run on the Ortho VITROS 5600 instrument according to manufacturer’s instructions and the signal-to-cutoff ratio was automatically calculated by the system. The laboratorians completing the OVSARS2IgG were blinded to clinical information on the specimens, including age, gender, SARS-CoV-2 antibody test results from the Wadsworth Center clinical assay, PRNT results, and date of collection.
Statistical Analyses
Correlation between age and neutralizing titer was assessed with a two-tailed Spearman’s r test. Statistical significance of correlations and comparisons between PRNT titers, DPID, and OVSARS2IgG ratios were computed using the Kruskal-Wallis test with Dunn’s correction for multiple comparisons when comparing three or more groups. The Mann-Whitney test was applied when comparing two groups of a continuous variable, and the Kolmogorov-Smirov test was used when comparing two groups of a discrete variable. The sensitivity, specificity, positive predictive value, and negative predictive value were calculated using the Wilson-Brown method for calculating 95% confidence intervals. A two-sided Fisher’s exact test was used to assess significance of the effect sizes calculated.
Data Availability
Yes
Author Contributions
Study design: RCG. Experimentation: RCG, ADP, AFP, TJS. Materials/support: M.P., D.S., KAM. Data analysis: RCG. All authors contributed to the writing and/or editing of the manuscript.
Acknowledgements
We thank the Tissue Culture and Media Core of the Wadsworth Center for the provision of cultured cells and reagents, Jess Machowski, Sean Bialosuknia, and the Diagnostic Immunology team at Wadsworth Center for continued support, the Arbovirus and Rabies Laboratories at Wadsworth for support and technical assistance, and the many selfless plasma donors who have come forward in support of their communities in the fight against COVID-19. Support was provided by CDC ELC CARES for COVID-19.
Footnotes
Conflict of interests: The authors have declared that no conflict of interest exists.