Abstract
Background The decline in COVID-19 mRNA vaccine effectiveness (VE) is well established, however the impact of variant-specific immune evasion and waning protection remains unclear. Here, we use whole-genome-sequencing (WGS) to tease apart the contribution of these factors on the decline observed following the introduction of the Delta variant. Further, we evaluate the utility of calendar-period-based variant classification as an alternative to WGS.
Methods We conducted a test-negative-case-control study among people who received SARS-CoV-2 RT-PCR testing in the Yale New Haven Health System between April 1 and August 24, 2021. Variant classification was performed using WGS and secondarily by calendar-period. We estimated VE as one minus the ratio comparing the odds of infection among vaccinated and unvaccinated people.
Results Overall, 2,029 cases (RT-PCR positive, sequenced samples) and 343,985 controls (negative RT-PCRs) were included. VE 14-89 days after 2nd dose was significantly higher against WGS-classified Alpha infection (84.4%, 95% confidence interval: 75.6-90.0%) than Delta infection (68.9%, CI: 58.0-77.1%, p-value: 0.013). The odds of WGS-classified Delta infection were significantly higher 90-149 than 14-89 days after 2nd dose (Odds ratio: 1.6, CI: 1.2-2.3). While estimates of VE against calendar-period-classified infections approximated estimates against WGS-classified infections, calendar-period-based classification was subject to outcome misclassification (35% during Alpha period, 4% during Delta period).
Conclusions These findings suggest that both waning protection and variant-specific immune evasion contributed to the lower effectiveness. While estimates of VE against calendar-period-classified infections mirrored that against WGS-classified infections, our analysis highlights the need for WGS when variants are co-circulating and misclassification is likely.
Summary of main points Using whole genome sequencing, we provide direct evidence of waning vaccine effectiveness and variant-specific immune evasion during the Delta wave. Effectiveness estimates against calendar-period-classified infections approximated estimates against WGS-classified infections, however, calendar-period classification was associated with a variant misclassification.
Competing Interest Statement
AIK serves as an expert panel member for Reckitt Global Hygiene Institute, scientific advisory board member for Revelar Biotherapeutics and a consultant for Tata Medical and Diagnostics and Regeneron Pharmaceuticals, and has received grants from Merck, Regeneron Pharmaceuticals and Tata Medical and Diagnostics for research related to COVID-19. W.L.S. was an investigator for a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; is a technical consultant to Hugo Health, a personal health information platform, and co-founder of Refactor Health, an AI-augmented data management platform for healthcare; and has received grants from Merck and Regeneron Pharmaceutical for research related to COVID-19. Other authors declare no conflict of interest. JDH, RC, SM, DF, SH, and AZ are employees and shareholders of Regeneron Pharmaceuticals, Inc
Funding Statement
Funding for the Studying COVID-19 Outcomes after SARS-CoV-2 Infection and Vaccination (SUCCESS) Study was provided by Regeneron Pharmaceuticals, Inc. (CLINICAL COLLABORATION STUDY AGREEMENT R0000-COV-CES-2116), the Beatrice Kleinberg Neuwirth and Sendas Family Funds and the Yale Schools of Public Health and Medicine. Some of the study results were obtained with the support of a research grant from the Investigator-Initiated Studies Program of Merck Sharp & Dohme Corp (Title: Harnessing Large Cohorts and a Rapid Knowledge Pipeline to Elucidate Immunity to SARS-CoV-2 Infection; MISP Database No. 60487).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by the Yale Institutional Review Board (ID#2000030222).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
Data cannot be shared publicly because of the presence of potentially identifiable health information. Requests for access can be directed to the corresponding author and Yale Human Research Protection Program (hrpp{at}yale.edu).
