Abstract
With the evidence of waning immunity of the BNT162b2 vaccine, a national third dose vaccination campaign was initiated in Israel during August 2021; other countries have announced their intention to administer a booster shot as well. Leveraging data from Maccabi Healthcare Services, we conducted a preliminary retrospective study aimed at evaluating initial short-term effectiveness of a three dose versus a two dose regimen against infection due to the Delta variant of SARS-CoV-2, using two complementary approaches; a test-negative design and a matched case-control design. We found that 7-13 days after the booster shot there is a 48-68% reduction in the odds of testing positive for SARS-CoV-2 infection and that 14-20 days after the booster the marginal effectiveness increases to 70-84%. Further studies are needed to determine the duration of protection conferred by the third dose and its effect on severe disease.
Introduction
The short-term effectiveness of a two-dose regimen of the BioNTech/Pfizer mRNA BNT162b2 vaccine against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) was demonstrated both in clinical trials1,2 and real-world settings.3,4 However, long-term effectiveness remains undetermined, as evidence of waning immunity has surfaced both in terms of antibody dynamics over time5–7 and protection against infection.8
The Delta (B.1.617.2) variant of SARS-CoV-2 was the dominant strain in Israel during the summer of 2021 and caused a rapidly growing number of cases, many in vaccinated individuals.9 A national third-dose (booster) vaccination campaign was initiated in Israel, and as of August 24, 2021, a booster dose was recommended for those aged 30 and over as well as for high-risk populations.10 By August 27, 2021, over 1.9 million individuals had received a booster shot.9 Current guidelines state that a minimum interval of 5 months since receipt of the second dose is required to be eligible for the booster dose. According to recent announcements, booster shots will be offered to individuals in the United States and United Kingdom in the coming months.
Few studies on a third-dose regimen have been published to date, all of which are in high-risk populations, such as transplant patients.11,12 These reported adequate antibody responses, though follow-up time was short and cohort sizes small. Recently, Pfizer and BioNTech released a statement regarding a reported on-going trial, in which a booster was administered 6 months after the second dose. The report indicated 5 to 10 times higher neutralization titers after the third dose, though neither data nor manuscript have yet to be published.13
To this end, we conducted a preliminary retrospective study aimed at evaluating initial short-term marginal effectiveness of the third dose of the BNT162b2 vaccine compared to a two-dose regimen, leveraging data from Maccabi Healthcare Services (MHS), Israel’s second largest Health Maintenance Organization, which covers 2.5 million members.
We used two complementary approaches to evaluate to marginal benefit of the third dose, both previously undertaken to evaluate SARS-CoV-2 vaccine effectiveness, each with its own limitations: a test-negative design and a matched case-control design (Methods).
Methods
Data collection and study population
Anonymized Electronic Medical Records (EMRs) were retrieved from MHS’ centralized computerized database. MHS is a 2.5-million-member, state-mandated, non-for-profit, second largest health fund in Israel, which covers 26% of the population and provides a representative sample of the Israeli population. The study population consisted of MHS members, aged 40 and above, who received either two or three doses of the BNT162b2 vaccine. Analyses focused on the period from January 2021 (when the second dose was first administered among eligible individuals) to August 21, 2021, as the booster dose was widely administered from August 1 onwards. Participants were excluded from the study if they disengaged from MHS for any reason prior to March 2020 or if they tested positive for SARS-CoV-2 by a polymerase chain reaction (PCR) test before the start of the follow-up period.
Individual-level data for the study population included age (in 10-year age categories), biological sex, socioeconomic status (SES) index, and a coded geographical statistical area (GSA; the smallest geostatistical unit assigned by Israel’s National Bureau of Statistics, which correspond to neighborhoods). The SES index was measured on a scale from 1 (lowest) to 10 based on several parameters including household income, educational qualifications, household crowding, and car ownership. Data collected also encompassed the last documented body mass index (BMI) (where obesity was defined as BMI ≥ 30) and information on chronic diseases from MHS’ automated registries, including cardiovascular diseases,14 hypertension,15 diabetes,16 chronic kidney disease (CKD),17 chronic obstructive pulmonary disease (COPD), and immunocompromised conditions, as well as data on cancer from the National Cancer Registry.18 COVID-19-related information included dates of the first, second, and third dose of the vaccine (if received) and results of any PCR tests for SARS-CoV-2, including tests performed outside of MHS.
Statistical analysis
Main analysis: test-negative design
For the main analysis, we used a test-negative design,19,20 where ‘cases’ were defined as those who had a positive PCR test for SARS-CoV-2 and ‘controls’ were those testing negative. Individuals could contribute multiple negative tests to the analysis but were excluded once they tested positive. If multiple tests were conducted within a 5-day period, the day of test was considered to be the first day of that test series. In a sensitivity analysis we included all tests regardless of serial testing, and the results were unchanged. The analysis sought to estimate the reduction in the odds of a positive test at different time intervals following receipt of the booster (third) dose (0-6 days, 7-13 days, 14-20 days) compared to two-dose only vaccinees. The 7-day and 14-day cutoffs for the third dose were chosen based on second-dose research.3,21 Covariates included the 10-year age category, biological sex, time since receipt of the 2nd dose (time category), and comorbidities (diabetes, immunosuppression status, BMI ≥ 30, CVD). An additional covariate consisted of the number of positive tests perfomed on that day througout the population (log-transformed), attempting to adjust for variability of levels of exposure at different time points. In sensitivity analyses, we evaluated two alternative ways to adjust for time-varying infection risk, by using a covariate consisting of the number of positive tests per day stratified by socioeconomic level, or by using a series of dummy variables representing calendar week. These alternatives yielded estimates of vaccine effectiveness that were similar to the results presented in the main analysis. SES category, COPD, hypertension, and CKD were also tested in the model but were not significant and not included in the final model; their inclusion/exclusion did not influence the estimates of the effect of the booster dose.
A logistic regression model was fit to the data. The marginal benefit of the third dose (compared to those receiving two doses) was calculated as 100%*(1-(Odds Ratio)) for each of the booster dose time-categories.
Secondary analysis: matched case-control design
As a complementary analysis, we used a matched case-control design.22,23 Cases were defined as individuals with a positive PCR test occurring after August 1, 2021, among those 40 years of age or older who did not have a previous positive test recorded and who received at least two doses of the vaccine. Up to 20 controls per case were drawn from the entire population (64% of the population were matched to 20 controls, 81% of the population had at least 10 controls, and 90% of the population had at least 5 controls). Eligible controls were individuals who had not tested positive (i.e., with either no positive PCR tests or negative tests) before the date when the case was tested and who had received at least two doses of the vaccine. Controls were matched by 10-year age category, residential socioeconomic status, biological sex, and the month when the second dose was administered. Both conditional and unconditional logistic regression models were fit to the data,24 and the covariates were the same as described for the test-negative analysis, except socioeconomic status and biological sex, which were not significant and were dropped from the analysis.
Analyses were performed using R version 4.0.5.
Ethics declaration
This study was approved by the MHS (Maccabi Healthcare Services) Institutional Review Board. Due to the retrospective design of the study, informed consent was waived by the IRB and all identifying details of the participants were removed before computational analysis.
Data availability statement
According to the Israel Ministry of Health regulations, individual-level data cannot be shared openly. Specific requests for remote access to de-identified community-level data should be referred to KSM, Maccabi Healthcare Services Research and Innovation Center.
Code availability statement
Specific requests for remote access to the code used for data analysis should be referred to KSM, Maccabi Healthcare Services Research and Innovation Center.
Results
From August 1, when the booster dose became widely available, through August 21, 2021, 182,076 PCR tests were performed among 153,753 MHS members over the age of 40 who did not have a previous documented infection. Baseline characteristics of the participants are given in Supplementary Table 1 for tests performed during August. During the period when the booster was available, 8,285 positive tests and 149,379 total tests (5.5%) were in the two-dose group and 1,188 positive tests and 32,697 total tests (3.6%) in the three-dose group. The percent positive was highest in those who had not not received a booster and in those who had received a booster in the previous 7 days, and was lowest in individuals who had received the booster more than two weeks prior (Table 1).
The marginal effectiveness of the third dose compared to two doses increased over time following receipt of the booster, with no marginal effectiveness in the first 7 days (3%; 95% CI: -5%, 10%), moderate marginal effectiveness in days 7-13 (48%; 95% CI: 42%, 54%), and high marginal effectiveness in days 14-20 (79%; 95% CI: 72%, 84%) (Supplementary Tables 2 and 3, Figure 1).
Similar to the results from the test-negative analysis, the matched case-control analsysis estimated the marginal effectiveness of the booster dose compared to the second dose increased from 39% (95% CI: 34%, 44%) 0-6 days after the booster to 53% (95% CI: 48%, 58%) 7-13 days after the booster and 70% (95% CI: 62%, 76%) 14-20 days after the booster (Supplementary Tables 2 and 4). A conditional logistic regression model gave qualitatively similar results (Supplementary Table 2).. Baseline characteristics of the participants are given in Supplementary Table 5.
Discussion
In this study, we found that a third dose of the BioNTech/Pfizer mRNA BNT162b2 vaccine provided additional protection against detected infection. Across the test-negative and matched case-control analyses, we estimated a 48-68% reduction in the odds of testing positive for SARS-CoV-2 after 7-13 days and 70-84% 14-20 days after the booster compared to two doses.
Our study has the inherent limitation of being short-term and preliminary, and we only evaluate marginal effectiveness against infection rather than severe disease. The total benefit of the vaccine program will depend both on the long-term effectiveness of the first two doses of the vaccine, accounting for waning, and the marginal improvements conferred by receipt of the booster. These analyses focused on infections, which accrue quickly and in high numbers. As more time elapses, it will be possible to evaluate the effects on more rare but severe outcomes, such as hospitalization and death. It will also be important to monitor waning of effectiveness following receipt of the booster dose. There are methodological limitations to these analyses as well. As in every observational study, there is a potential bias relating to healthcare seeking behavior in terms of PCR test frequency in the examined groups.
This could account for the discrepancy of the results in days 0-6 between the matched case-control analysis and the test-negative analysis. The test-negative design attempts to mitigate that potential bias but it cannot eliminate it. As those eligible for the third dose are early vaccinees, and given that chronically-ill patients were prioritized for vaccination, uncontrolled confounding by indication is possible. However, the matching and adjustment perfomed renders residual confounding by unmeasured factors less likely. We use odds ratios as an approximation of the relative risk and marginal effectiveness of the third dose, which is a reasonable approximation given that outcome is relatively rare. Another limitation stems from the fact that the Delta variant is currently the dominant strain in Israel, thus the risk reduction against other strains cannot be inferred.
In conclusion, other studies have demonstrated that protection of vaccines against SARS-CoV-2 wanes over time. Our analyses show that the waning of vaccine-induced protection against infection, seems to be counteracted in the short term by the third dose. Further monitoring of data from this population is needed to determine the duration of immunity following the booster.
Data Availability
According to the Israel Ministry of Health regulations, individual-level data cannot be shared openly. Specific requests for remote access to de-identified community-level data should be referred to KSM, Maccabi Healthcare Services Research and Innovation Center.