Effectiveness of COVID-19 vaccines against Omicron or Delta symptomatic infection and severe outcomes

Sarah A. Buchan, Hannah Chung, Kevin A. Brown, Peter C. Austin, Deshayne B. Fell, Jonathan B. Gubbay, Sharifa Nasreen, Kevin L. Schwartz, Maria E. Sundaram, Mina Tadrous, Kumanan Wilson, Sarah E. Wilson, Jeffrey C. Kwong the Canadian Immunization Research Network (CIRN) Provincial Collaborative Network (PCN) Investigators
doi: https://doi.org/10.1101/2021.12.30.21268565

ABSTRACT

Background The incidence of SARS-CoV-2 infection, including among those who have received 2 doses of COVID-19 vaccines, increased substantially following the emergence of Omicron in Ontario, Canada.

Methods Applying the test-negative study design to linked provincial databases, we estimated vaccine effectiveness (VE) against symptomatic infection and severe outcomes (hospitalization or death) caused by Omicron or Delta between December 6 and 26, 2021. We used multivariable logistic regression to estimate the effectiveness of 2 or 3 COVID-19 vaccine doses by time since the latest dose, compared to unvaccinated individuals.

Results We included 16,087 Omicron-positive cases, 4,261 Delta-positive cases, and 114,087 test-negative controls. VE against symptomatic Delta infection declined from 89% (95%CI, 86-92%) 7-59 days after a second dose to 80% (95%CI, 74-84%) after ≥240 days, but increased to 97% (95%CI, 96-98%) ≥7 days after a third dose. VE against symptomatic Omicron infection was only 36% (95%CI, 24-45%) 7-59 days after a second dose and provided no protection after ≥180 days, but increased to 61% (95%CI, 56-65%) ≥7 days after a third dose. VE against severe outcomes was very high following a third dose for both Delta and Omicron (99% [95%CI, 98-99%] and 95% [95%CI, 87-98%], respectively).

Conclusions In contrast to high levels of protection against both symptomatic infection and severe outcomes caused by Delta, our results suggest that 2 doses of COVID-19 vaccines only offer modest and short-term protection against symptomatic Omicron infection. A third dose improves protection against symptomatic infection and provides excellent protection against severe outcomes for both variants.

INTRODUCTION

The World Health Organization declared Omicron a Variant of Concern on November 26, 2021 due to its highly transmissible nature and risk of immune evasion.1 In Ontario, Canada, the first detected case of Omicron was identified on November 22, 2021; within weeks, Omicron accounted for the majority of new cases. Despite very high 2-dose COVID-19 vaccine coverage (88% among those aged ≥18 years by mid-December 2021),2 the rate of cases among fully vaccinated individuals increased substantially during this period.3

A reduction in neutralizing antibodies against Omicron following second and third doses of mRNA vaccines has been established,4-9 but real-world data evaluating vaccine performance against Omicron infection are still emerging.10-18 We previously estimated vaccine effectiveness (VE) against infection (irrespective of symptoms or severity) in the initial period following identification of Omicron in Ontario, in order to support urgent public health decisions.19 At that time, data on symptoms were unavailable, and few cases involved hospital admission to evaluate severe outcomes. The objective of this analysis was to estimate VE against symptomatic infection and severe outcomes caused by Omicron or Delta in Ontario.

METHODS

Study population, setting, and design

We used the test-negative study design and linked provincial databases to estimate VE. We included symptomatic individuals aged ≥18 years with provincial health insurance who had a reverse transcription real-time polymerase chain reaction (PCR) test for SARS-CoV-2 between December 6 and 26, 2021. Our study period was selected to align with a provincial initiative to universally screen positive specimens to differentiate Omicron and Delta cases (details below) and prior to restrictions in laboratory-based PCR test eligibility announced on December 30, 2021.20

We excluded: long-term care residents; individuals who had received only 1 dose or 4 doses of COVID-19 vaccine(s) or who had received a second dose <7 days prior to being tested; individuals who tested positive for SARS-CoV-2 within the previous 90 days; individuals who had received 2 or 3doses of ChAdOx1 (AstraZeneca Vaxzevria, COVISHIELD) because VE for that primary schedule is known to be lower and this product has been rarely used as a third dose;21 those who had received non-Health Canada authorized vaccine(s) for any dose; and those who received the Janssen (Johnson & Johnson) vaccine (which, while approved for use in Canada, was largely unavailable and very rarely used [<0.1% of the Ontario population received this vaccine]22).

Data sources

We linked provincial SARS-CoV-2 laboratory testing, reportable disease, COVID-19 vaccination, and health administrative databases using unique encoded identifiers and analyzed them at ICES, a not-for-profit provincial research institute (www.ices.on.ca).

Outcomes

We identified individuals with confirmed SARS-CoV-2 infections using provincial reportable disease data and/or laboratory data.

For VE against symptomatic infection, we restricted our analysis to individuals who had at least one COVID-19-related symptom (self-reported or measured) at the time of testing, as identified in the laboratory testing data.23 The specimen collection date was used as the index date. Severe outcomes were defined as hospital admission or death using the earliest of the specimen collection date, hospital admission date, or death date as the index date. Due to lags in data reporting in health administrative data, we used reportable disease data to identify severe outcomes. For symptomatic individuals who tested negative for SARS-CoV-2 repeatedly during the study period and were considered controls (for both outcomes), we randomly selected one negative test.

Positive specimens identified through whole genome sequencing as B.1.1.529 lineage or found to have S-gene target failure (SGTF; a proxy measure for Omicron resulting from the amino acid 69-70 spike deletion that does not occur with Delta) were considered Omicron infections. Specimens sequenced as B.1.617 lineage or found to be negative for SGTF were considered Delta infections. Individuals with unknown or inconclusive SGTF results were excluded.24 Between December 6 and 24, 2021, all specimens with a positive PCR result (and a cycle threshold [Ct] value ≤35) should have been sent for testing using Thermofisher Taqpath™ COVID-19 PCR to identify SGTF; as such, we selected our primary study period to approximate the period of universal screening for SGTF. Prior to December 20, SGTF-positive specimens with Ct values ≤30 also underwent whole genome sequencing (WGS). In Ontario, the estimated sensitivity of SGTF relative to WGS for detecting Omicron among samples with Ct ≤30 was 98.9% and the specificity was 99.9%.24

COVID-19 vaccination

To date, Ontario has primarily used 3 products (BNT162b2 [Pfizer-BioNTech Comirnaty], mRNA-1273 [Moderna Spikevax], and ChAdOx1) in its COVID-19 vaccination program. Due to fluctuating vaccine supply, varying dosing intervals and mixed vaccine schedules were employed. Using a centralized province-wide vaccine registry to identify receipt of COVID-19 vaccines, we classified individuals depending on whether they had received 2 or 3 doses of vaccine and the timing of these doses relative to the index date. We included individuals who received at least 1 mRNA vaccine for the primary 2-dose series (since a mixed schedule consisting of ChAdOx1 and an mRNA vaccine has previously been demonstrated to have similar VE as 2 mRNA vaccines).21 For the third dose, we included individuals who received any mRNA vaccine and also stratified our results by specific third dose product. All comparisons used those who had not yet received any doses (i.e., “unvaccinated”) by the index date as the reference group.

Third dose eligibility in Ontario began in August 2021 and expanded gradually.25,26 Initially, only moderately or severely immunocompromised individuals were eligible to receive a third dose as part of an extended primary series.27 Shortly thereafter, third doses (i.e., ‘boosters’) were provided to residents of higher-risk congregate settings for older adults (e.g., long-term care homes, high-risk retirement homes).28 In early October, older adults living in other congregate care settings, including all remaining retirement homes, became eligible. All individuals aged ≥70 years and healthcare workers became eligible on November 6, followed by individuals aged ≥50 years on December 13 and individuals aged ≥18 years on December 18.29,30 The standard interval for third dose eligibility was generally ≥168 days following a second dose but was shortened to ≥84 days on December 15.31

Covariates

From various databases, we obtained information on each individual’s age (in 10-year age bands), sex, public health unit region of residence, number of SARS-CoV-2 PCR tests during the 3 months prior to December 14, 2020 (as a proxy for healthcare worker status based on the start date of the provincial COVID-19 vaccine program), past SARS-CoV-2 infection >90 days prior to index date, comorbidities associated with increased risk of severe COVID-19, influenza vaccination status during the 2019/2020 and/or 2020/2021 influenza seasons (as a proxy for health behaviours), and neighbourhood-level information on median household income, proportion of the working population employed as non-health essential workers, mean number of persons per dwelling, and proportion of the population who self-identify as a visible minority. These databases and definitions have been fully described elsewhere.23

Statistical analysis

For both Omicron and Delta symptomatic infections, we calculated means (continuous variables) and frequencies (categorical variables) of baseline characteristics and compared test-positive cases and test-negative controls using standardized differences.

We used multivariable logistic regression to estimate adjusted odds ratios (aOR) comparing the odds of vaccination in each “time since latest dose” (for both second and third dose recipients) interval among cases with the odds among controls, while adjusting for all listed covariates and a categorical variable representing week of test. VE was calculated using the formula VE=(1-aOR)x100%. We estimated VE by vaccine schedule and time since latest dose.

All analyses were conducted using SAS Version 9.4 (SAS Institute Inc., Cary, NC). All tests were two-sided and used p<0.05 as the level of statistical significance.

Sensitivity analyses

We performed two sensitivity analyses. First, we included an additional 2 weeks of data (November 22 to December 5, 2021), representing the period immediately following Omicron identification in the province, in order to align with prior estimates of VE against infection and to observe how VE estimates against symptomatic Omicron infection changed over time.19 Due to the rapid rise of Omicron during the study period, we estimated VE cumulatively over time by extending the study period by 1-week increments to see how VE against Omicron changed as it became the predominant strain. We also performed a sensitivity analysis for severe outcomes using a less specific definition of Omicron to allow for a larger sample size. In this sensitivity analysis, specimens collected from December 21 onward (when the prevalence of SGTF among cases in the province was >90%) with no or inconclusive SGTF results were considered to be Omicron.

Supplemental analysis

We also repeated our primary analysis (i.e., December 6-26, 2021) using any infection (as opposed to symptomatic infection) in order to compare results from an updated time frame to our earlier pre-print.

RESULTS

Between December 6 and 26, 2021, we included 16,087 Omicron-positive cases, 4,261 Delta-positive cases, and 114,087 test-negative controls. Compared to controls, Omicron cases were: younger (mean age 36.0 years vs. 42.0 years); more likely to be male; less likely to have any comorbidities; less likely to have received an influenza vaccine; more likely to have occurred during the last week of the study period; less likely to have previously tested positive for SARS-CoV-2; more likely to have received 2 doses of COVID-19 vaccines; and less likely to have received a third dose (Table 1).

View this table:
Table 1.

Descriptive characteristics of subjects tested for SARS-CoV-2 with COVID-19-relevant symptoms during the period December 6 to 26, 2021, comparing Omicron cases and Delta cases with SARS-CoV-2-negative controls

In contrast, Delta cases were more similar to controls than were Omicron cases in some respects (e.g., age, comorbidities) but were more different in others, such as being more likely to have occurred earlier in the study period, and more likely to be unvaccinated (29.4% vs. 4.1%).

In the Omicron VE analyses, vaccinated (i.e., 2 or 3 dose) subjects were more likely to be older, female, influenza vaccine recipients, and residents of neighbourhoods with higher income and fewer essential workers than unvaccinated subjects (Table 2). Recipients of a third dose were more likely to have comorbidities and to have been tested in the last week of the study period. We observed similar patterns for subjects in the Delta VE analyses (Supplementary Table 1).

View this table:
Table 2.

Descriptive characteristics of subjects tested for SARS-CoV-2 with COVID-19-relevant symptoms during the period December 6 to 26, 2021, comparing vaccinated and unvaccinated subjects, Omicron cases and SARS-CoV-2-negative controls only

After 2 doses of COVID-19 vaccines (with at least 1 mRNA vaccine), VE against symptomatic Delta infection declined steadily over time from 89% (95%CI, 86-92%) 7-59 days after a second dose to 80% (95%CI, 74-84%) after ≥240 days, but increased to 97% (95%CI, 96-98%) ≥7 days after a third dose (Table 3; Figure 1A). VE against symptomatic Omicron infection was lower relative to Delta for the entire period and waned more rapidly, from 36% (95%CI, 24-45%) 7-59 days after a second dose to 1% (95%CI, –8% to 10%) 180-239 days after a second dose. VE against symptomatic Omicron infection was 61% (95%CI, 56-65%) ≥7 days after a third dose and was similar regardless of the mRNA product administered.

View this table:
Table 3.

Estimates of vaccine effectiveness* against symptomatic infection or severe outcomes (hospitalization or death) caused by Omicron or Delta during the period December 6 to 26, 2021, by time since latest dose

Figure 1.
Figure 1.

Estimates of vaccine effectiveness against A) symptomatic infection and B) severe outcomes (hospitalization or death) caused by Omicron or Delta during the period December 6 to 26, 2021, by time since latest dose

Vaccine effectiveness (VE) for mRNA-1273 0-6 days after the third dose was estimated as 100% based on zero vaccinated test-positive hospitalized cases and was therefore not presented in panel B. The lower 95% confidence limit for Omicron VE against severe outcomes 7-59 days after a second dose was -106 and 60-119 days after a second dose was -71.

VE was higher against severe outcomes when compared to symptomatic infection and did not exhibit the same degree of waning (Figure 1B). VE was also higher against severe outcomes caused by Delta than Omicron in the time following a second dose, but confidence intervals were very wide for some Omicron estimates. VE against severe outcomes ≥7 days following a third dose were very similar for Delta and Omicron (99% [95%CI, 98-99%] and 95% [95%CI, 87-98%], respectively).

In the sensitivity analysis examining cumulative changes in VE over calendar time, point estimates generally rose and confidence intervals narrowed as more data accumulated (Figure 2). There were some changes in the characteristics of Omicron cases over time, including an increase in mean age (from 32.0 years in the first 3 weeks after Omicron emergence to 36.3 years in the final week of our study), and a decrease in the proportion of subjects who resided in the highest neighbourhood income quintile (from 35.4% to 27.8%) (Supplementary Table 2). When using a less specific definition for Omicron (Supplementary Table 3), VE estimates against severe outcomes were higher and substantially more stable (Supplementary Table 4).

Figure 2.
Figure 2.

Estimates of vaccine effectiveness (VE) against symptomatic Omicron infection by cumulative time period to demonstrate the impact of adding data from successive weeks to VE estimates (panel A: November 22 to December 21, 2021; panel B: November 22 to December 19, 2021; panel C: November 22 to December 26, 2021)

The lower 95% confidence limit for vaccine effectiveness against symptomatic Omicron infection ≥240 days after a second dose was -174

In our supplemental analysis of VE against any infection (irrespective of symptoms and severity), we found very similar results to our earlier estimates but with narrower confidence intervals when using the new study period (Supplementary Figure 1).

DISCUSSION

In Ontario, between December 6 and 26, 2021, we found the effectiveness of 2 doses of COVID-19 vaccines against symptomatic infection to be substantially lower for Omicron than for Delta; VE against Omicron symptomatic infection was minimal from 60 days after a second dose and there was no significant protection beyond 180 days. However, VE was 61% ≥7 days following a third dose. Against severe outcomes, including hospitalization and death, VE shortly following a third dose was similar for Omicron and Delta (95% [95%CI 87-98%] and 99% [95% CI 98-99%], respectively).

Substantial waning of 2-dose VE against symptomatic infection has been observed in England, with lower VE against Omicron than Delta at each interval following 2 or 3 doses;11,13 our results demonstrated a similar pattern, with a marked reduction in 2-dose (with at least one being an mRNA vaccine) and 3-dose effectiveness against symptomatic Omicron infection relative to Delta. In the United Kingdom Health Security Agency (UKHSA) data, VE against symptomatic Omicron infection for 2 doses of BNT162b2 or mRNA-1273 declined to <20% from 20 weeks after a second dose. Following a third dose of mRNA vaccine, VE increased to ∼60-75% during the first 4 weeks, in line with our finding of 61% ≥7 days after a third dose.11 While the UK data suggest waning also occurs after a dose, insufficient time has elapsed for enough third dose recipients in Ontario to assess this. In Scotland, a third dose was associated with a two-thirds reduction in the odds of symptomatic Omicron infection relative to those who were ≥25 weeks post second dose in the early Omicron period.15

Although prior studies have demonstrated reduced neutralizing antibodies against Omicron relative to other variants following receipt of 2 mRNA vaccine doses4-8,32,33 (but with potent neutralization following a third dose34,35,36), CD8+ cytotoxic T cells are less impacted by mutations in the Omicron variant and likely continue to provide protection against severe disease.35,37 Emerging real-world data demonstrate that protection against severe outcomes is more preserved than against infection in the Omicron era. In South Africa, effectiveness against hospitalization was 93% in the pre-Omicron period and was 70% in the Omicron period.16 In England, VE against hospitalization due to Omicron also appears to be better maintained relative to symptomatic infection with Omicron.10,11,38 In an analysis of the overall population and for all vaccines (i.e., BNT162b2, mRNA-1273, and ChAdOx1), VE against Omicron-related hospitalization declined with time since a second dose but to a lesser extent than against symptomatic infection.11 Following a third dose, VE was restored to 85-95% during the first 3 months. In California, VE against Omicron-related hospitalization was 89% in the first 3 months following 3 doses of BNT162b2.12 In another study in the United States (US), 3-dose VE against hospitalization when Omicron was predominant was estimated at 90%.17 Our 3-dose estimates against severe outcomes were very similar to these results from England and the US. Although our 2-dose estimates against severe Omicron-related outcomes were challenging to compare given instability and wide confidence intervals, they do suggest less waning against hospitalization than has been observed elsewhere and this finding is aligned with surveillance data in Ontario.39,40

Direct comparisons to other jurisdictions are challenging41 due to differences in study methodology, outcome definitions (i.e., identification of Omicron and Delta based on laboratory confirmation vs. time-based criteria), intervals following latest dose selected to monitor VE, vaccination policies (i.e., homologous vs. heterologous vaccine schedules, third dose eligibility criteria, product-specific policies [use of mRNA vs. viral vector vaccines, a preferential recommendation in Ontario of BNT162b2 for young adults]),42,43 population age structures, public health measures implemented during the study period (e.g., vaccine certificates, mask mandates44), testing patterns, and use of antivirals or other therapies. Further, Ontario has experienced a lower cumulative incidence of reported infections and has attained higher vaccine coverage than other countries that have estimated VE against Omicron to date,45 and thus has a potentially dissimilar distribution of infection-induced versus vaccine-induced immunity.45,46 Despite this, the general trends across the studies are similar and suggest immune evasion by Omicron.10-12,15,17,18,47

In our earlier analysis encompassing the first month of Omicron emergence in Ontario, we estimated VE against infection (irrespective of presence of symptoms or severity, due to the data availability at the time) and observed statistically significant negative VE estimates for some time intervals following a second dose.19 This was also observed in the UK (estimated against symptomatic infection) for ChAdOx1 recipients and Denmark (estimated against any infection), where analyses were conducted promptly after Omicron emergence.13,14,48,49 As more data accumulated in the UK, updated results demonstrated that while protection was still minimal for longer periods after a second dose, the VE estimates were no longer negative.11,38 In Ontario, the initial negative VE estimates were likely due to a combination of factors. First, a vaccine certificate system was introduced in Ontario in the fall of 2021, such that only individuals who have received 2 vaccine doses are permitted to travel by air and rail, and to enter restaurants, bars, gyms, and large cultural and sporting events. Introduction of Omicron into Ontario by vaccinated travellers and the initial spread via household and social contacts (who are also more likely to be vaccinated) likely resulted in increased risk of exposure to Omicron among vaccinated individuals before gradually diffusing into the broader population, including unvaccinated individuals. This hypothesis is supported by earlier Omicron cases being younger, residing in higher-income neighbourhoods, and being more highly vaccinated than the test-negative controls during the same period. In subsequent weeks, cases became more similar to test-negative controls in terms of age, presence of comorbidities, and sociodemographic measures; the proportion unvaccinated also increased over time among cases, eventually becoming higher than among test-negative controls. Second, use of infection rather than symptomatic infection as the outcome, as in the initial analysis,19 may also, introduce bias in VE estimates because indications for testing (e.g., contact with a case) may be differential by vaccination status. If asymptomatic vaccinated individuals are more likely to be tested (e.g., healthcare workers, individuals exposed to cases), vaccinated Omicron cases would be more likely to be identified compared to unvaccinated Omicron cases, leading to an underestimate of VE.50 Restricting the analysis to symptomatic individuals, as presented here, should mitigate this potential source of bias.

Our study has several limitations. First, we were unable to differentiate individuals who received a third dose as part of an extended primary series (i.e., severely or moderately immunocompromised individuals) as well as higher-risk individuals who were eligible for a third dose earlier (e.g., residents of retirement homes). As third dose eligibility only expanded to all adults in mid-December, a proportion of subjects in this study who had a third dose may reflect these highly vulnerable populations; thus, our 3-dose VE estimates may be lower than what would be expected for the general population. Third dose eligibility and timing of primary series completion may result in differing characteristics of individuals by interval since last dose. Second, not all specimens were screened for SGTF due to the rapid rise in case volumes and eligibility criteria for screening, and WGS results for cases identified during our study period may not have been available at the time of analysis due to processing delays. In a sensitivity analysis for severe outcomes we obtained a higher VE estimate when we classified all cases after a certain date as Omicron. However, this less specific outcome may over-estimate VE if there is differential misclassification of the variant based on vaccination status (i.e., if Delta continues to circulate at a higher level in unvaccinated individuals, this would over-estimate VE). Third, changes in testing patterns, including increased use of rapid antigen tests (which are not captured in our data) and decreased PCR testing availability, may have impacted our estimates, but the direction of any resulting bias is uncertain. However, if vaccinated individuals are more likely to be tested and therefore captured in our data than unvaccinated individuals, then VE will be underestimated.50 Fourth, symptom information is not available for all laboratories submitting to Ontario’s centralized system; as such, symptomatic individuals who were tested but without this information recorded would have been excluded in our study.23 Fifth, despite ongoing high case counts, we were unable to extend our time period past the end of December due to restricted test eligibility and access, reduced SGTF screening and the likelihood of misclassification due to the potential rise of the BA.2 sub-lineage of Omicron, as noted elsewhere,38,51 but so far has been minimal in Ontario. Sixth, we were unable to estimate VE in the extended period of time following a third dose. Last, there may be residual confounding that was not accounted for in our analysis. This includes an inability to control for previous undocumented infections, which may be differential by vaccination status, and confounding due to behavioural patterns.

Our results demonstrate the importance of third doses to bolster protection against both infections and severe outcomes due to Omicron, although the duration of this protection is uncertain. They also suggest the continued need for public health measures, such as masking, physical distancing, and ventilation, to prevent infection and transmission. Further, these findings have potentially important implications for proof of vaccination requirements, in that 3 doses are necessary to reduce transmission in high-risk settings although they do not confer as much protection as observed against Delta. Our work adds to a rapidly evolving body of evidence that suggests that vaccine-induced protection depends on a variety of factors such as type of vaccine received, recipient age, time since latest dose, and circulating variant.

Conclusions

Our results suggest that protection from 2 doses of COVID-19 vaccines against symptomatic Omicron infection declines with time since a second dose, with no protection beyond 180 days, and is substantially lower than against Delta infection; a third dose of mRNA vaccine affords moderate protection against symptomatic Omicron infection in the immediate term. In contrast, protection against Omicron-related severe disease appears to be high with 2 doses and is further increased and is similar to Delta with a third dose. Additional tools beyond the currently available vaccines, such as ongoing public health measures, antivirals or other therapies, and new formulations of COVID-19 vaccines, are likely needed to mitigate the impact of Omicron and potential future variants.

Data Availability

The dataset from this study is held securely in coded form at ICES. While legal data sharing agreements between ICES and data providers (e.g., healthcare organizations and government) prohibit ICES from making the dataset publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at www.ices.on.ca/DAS (email: das@ices.on.ca).

Ethics approval

ICES is a prescribed entity under Ontario’s Personal Health Information Protection Act (PHIPA). Section 45 of PHIPA authorizes ICES to collect personal health information, without consent, for the purpose of analysis or compiling statistical information with respect to the management of, evaluation or monitoring of, the allocation of resources to or planning for all or part of the health system. Projects that use data collected by ICES under section 45 of PHIPA, and use no other data, are exempt from REB review. The use of the data in this project is authorized under section 45 and approved by ICES’ Privacy and Legal Office.

Data availability

The dataset from this study is held securely in coded form at ICES. While legal data sharing agreements between ICES and data providers (e.g., healthcare organizations and government) prohibit ICES from making the dataset publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at www.ices.on.ca/DAS (email: das{at}ices.on.ca).

Code availability

The full dataset creation plan and underlying analytic code are available from the authors upon request, understanding that the computer programs may rely upon coding templates or macros that are unique to ICES and are therefore either inaccessible or may require modification.

Author contributions

S.A.B, H.C., and J.C.K. designed the study. H.C. obtained the data and conducted all analyses (data set and variable creation and statistical modelling). S.A.B. and J.C.K. drafted the manuscript. All authors contributed to the analysis plan, interpreted the results, critically reviewed and edited the manuscript, approved the final version, and agreed to be accountable for all aspects of the work.

Competing interests

K.W. is CEO of CANImmunize and serves on the data safety board for the Medicago COVID-19 vaccine trial. The other authors declare no conflicts of interest.

Funding and disclaimers

This work was supported by the Canadian Immunization Research Network (CIRN) through a grant from the Public Health Agency of Canada and the Canadian Institutes of Health Research (CNF 151944). This project was also supported by funding from the Public Health Agency of Canada, through the Vaccine Surveillance Reference Group and the COVID-19 Immunity Task Force. This study was also supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH). J.C.K. is supported by Clinician-Scientist Award from the University of Toronto Department of Family and Community Medicine. P.C.A. is supported by a Mid-Career Investigator Award from the Heart and Stroke Foundation.

This work was supported by Public Health Ontario. This study was also supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH) and the Ministry of Long-Term Care (MLTC). This study was supported by the Ontario Health Data Platform (OHDP), a Province of Ontario initiative to support Ontario’s ongoing response to COVID-19 and its related impacts. The study sponsors did not participate in the design and conduct of the study; collection, management, analysis and interpretation of the data; preparation, review or approval of the manuscript; or the decision to submit the manuscript for publication. Parts of this material are based on data and/or information compiled and provided by the Canadian Institute for Health Information (CIHI) and by Cancer Care Ontario (CCO). However, the analyses, conclusions, opinions and statements expressed herein are solely those of the authors, and do not reflect those of the funding or data sources; no endorsement by ICES, MOH, MLTC, OHDP, its partners, the Province of Ontario, CIHI or CCO is intended or should be inferred.

Acknowledgments

We would like to acknowledge Public Health Ontario for access to vaccination data from COVaxON, case-level data from CCM and COVID-19 laboratory data, as well as assistance with data interpretation. We also thank the staff of Ontario’s public health units who are responsible for COVID-19 case and contact management and data collection within CCM. We thank IQVIA Solutions Canada Inc. for use of their Drug Information Database. The authors are grateful to the Ontario residents without whom this research would be impossible.

References

  1. 1.↵
    World Health Organization (WHO). Classification of Omicron (B.1.1.529): SARS-CoV-2 Variant of Concern [Internet] Geneva: WHO; 2021 [Available from: https://www.who.int/news/item/26-11-2021-classification-of-omicron-(b.1.1.529)-sars-cov-2-variant-of-concern.
  2. 2.↵
    Ontario Agency for Health Protection and Promotion (Public Health Ontario). COVID-19 Vaccine Uptake and Program Impact in Ontario: December 14, 2020 to December 19, 2021 Toronto, ON: Queen’s Printer for Ontario2021 [Available from: https://www.publichealthontario.ca/-/media/documents/ncov/epi/covid-19-vaccine-uptake-ontario-epi-summary.pdf?sc_lang=en accessed 30 December 2021.
  3. 3.↵
    Government of Ontario. COVID-19 vaccinations data: Queen’s Printer for Ontario; [Available from: https://covid-19.ontario.ca/data accessed December 25 2021.
  4. 4.↵
    Sheward DJ, Kim C, Pankow A, et al. Quantification of the neutralization resistance of the Omicron Variant of Concern. 2021. Available at: https://drive.google.com/file/d/1CuxmNYj5cpIuxWXhjjVmuDqntxXwlfXQ/view
  5. 5.
    Nemet I, Kliker L, Lustig Y, et al. Third BNT162b2 Vaccination Neutralization of SARS-CoV-2 Omicron Infection. N Engl J Med 2021 doi: 10.1056/NEJMc2119358
    OpenUrlCrossRefPubMed
  6. 6.
    Cele S, Jackson L, Khoury DS, et al. SARS-CoV-2 Omicron has extensive but incomplete escape of Pfizer BNT162b2 elicited neutralization and requires ACE2 for infection. medRxiv 2021:2021.12.08.21267417. doi: 10.1101/2021.12.08.21267417
    OpenUrlAbstract/FREE Full Text
  7. 7.
    Rössler A, Riepler L, Bante D, et al. SARS-CoV-2 B.1.1.529 variant (Omicron) evades neutralization by sera from vaccinated and convalescent individuals. medRxiv 2021:2021.12.08.21267491. doi: 10.1101/2021.12.08.21267491
    OpenUrlAbstract/FREE Full Text
  8. 8.↵
    Wilhelm A, Widera M, Grikscheit K, et al. Reduced Neutralization of SARS-CoV-2 Omicron Variant by Vaccine Sera and Monoclonal Antibodies. medRxiv 2021:2021.12.07.21267432. doi: 10.1101/2021.12.07.21267432
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    Dejnirattisai W, Shaw RH, Supasa P, et al. Reduced neutralisation of SARS-CoV-2 omicron B.1.1.529 variant by post-immunisation serum. Lancet 2021:DOI: https://doi.org/10.1016/S0140-6736(21)02844-0. doi: 10.1016/S0140-6736(21)02844-0
    OpenUrlCrossRef
  10. 10.↵
    Ferguson N, Ghani A, Cori A, et al. Report 49: Growth, population distribution and immune escape of Omicron in England. Imperial College London 2021 doi: https://doiorg/1025561/93038
  11. 11.↵
    UK Health Security Agency. COVID-19 vaccine surveillance report - week 3. 20 January 2022 [Available from: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1049160/Vaccine-surveillance-report-week-3-2022.pdf accessed 21 January 2022.
  12. 12.↵
    Tartof SY, Slezak JM, Puzniak L, et al. BNT162b2 (Pfizer–Biontech) mRNA COVID-19 Vaccine Against Omicron-Related Hospital and Emergency Department Admission in a Large US Health System: A Test-Negative Design. Available at SSRN: https://ssrn.com/abstract=4011905 or http://dx.doi.org/10.2139/ssrn.4011905.
  13. 13.↵
    Andrews N, Stowe J, Kirsebom F, et al. Effectiveness of COVID-19 vaccines against the Omicron (B.1.1.529) variant of concern. medRxiv 2021:2021.12.14.21267615. doi: 10.1101/2021.12.14.21267615
    OpenUrlAbstract/FREE Full Text
  14. 14.↵
    Hansen CH, Schelde AB, Moustsen-Helm IR, et al. Vaccine effectiveness against SARS-CoV-2 infection with the Omicron or Delta variants following a two-dose or booster BNT162b2 or mRNA-1273 vaccination series: A Danish cohort study. medRxiv 2021:2021.12.20.21267966. doi: 10.1101/2021.12.20.21267966
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    Sheikh A, Kerr S, Woolhouse M, et al. Severity of Omicron variant of concern and vaccine effectiveness against symptomatic disease: national cohort with nested test negative design study in Scotland. Preprint 2021 [Available from: https://www.pure.ed.ac.uk/ws/portalfiles/portal/245818096/Severity_of_Omicron_variant_of_concern_and_vaccine_effectiveness_against_symptomatic_disease.pdf.
  16. 16.↵
    Collie S, Champion J, Moultrie H, et al. Effectiveness of BNT162b2 Vaccine against Omicron Variant in South Africa. N Engl J Med 2021 doi: 10.1056/NEJMc2119270
    OpenUrlCrossRefPubMed
  17. 17.↵
    Thompson MG, Natarajan K, Irving SA, et al. Effectiveness of a Third Dose of mRNA Vaccines Against COVID-19–Associated Emergency Department and Urgent Care Encounters and Hospitalizations Among Adults During Periods of Delta and Omicron Variant Predominance — VISION Network, 10 States, August 2021–January 2022. MMWR Morb Mortal Wkly Rep 2022:ePub: 21 January 2022. DOI: http://dx.doi.org/10.15585/mmwr.mm7104e3external.
  18. 18.↵
    Tseng HF, Ackerson BK, Luo Y, et al. Effectiveness of mRNA-1273 against SARS-CoV-2 omicron and delta variants. medRxiv 2022:2022.01.07.22268919. doi: 10.1101/2022.01.07.22268919
    OpenUrlAbstract/FREE Full Text
  19. 19.↵
    Buchan SA, Chung H, Brown KA, et al. Effectiveness of COVID-19 vaccines against Omicron or Delta infection. medRxiv 2022:2021.12.30.21268565. doi: 10.1101/2021.12.30.21268565
    OpenUrlAbstract/FREE Full Text
  20. 20.↵
    Government of Ontario. Updated Eligibility for PCR Testing and Case and Contact Management Guidance in Ontario [Internet]: Queen’s Printer for Ontario; 2021 [cited 2022 January 25]. Available from: https://news.ontario.ca/en/backgrounder/1001387/updated-eligibility-for-pcr-testing-and-case-and-contact-management-guidance-in-ontario.
  21. 21.↵
    Skowronski DM, Setayeshgar S, Febriani Y, et al. Two-dose SARS-CoV-2 vaccine effectiveness with mixed schedules and extended dosing intervals: test-negative design studies from British Columbia and Quebec, Canada. medRxiv 2021:2021.10.26.21265397. doi: 10.1101/2021.10.26.21265397
    OpenUrlAbstract/FREE Full Text
  22. 22.↵
    Public Health Agency of Canada. Canadian COVID-19 vaccination coverage report.Ottawa: Public Health Agency of Canada; January 21, 2022. https://health-infobase.canada.ca/covid-19/vaccination-coverage/.
  23. 23.↵
    Chung H, He S, Nasreen S, et al. Effectiveness of BNT162b2 and mRNA-1273 covid-19 vaccines against symptomatic SARS-CoV-2 infection and severe covid-19 outcomes in Ontario, Canada: test negative design study. BMJ 2021;374:n1943. doi: 10.1136/bmj.n1943
    OpenUrlAbstract/FREE Full Text
  24. 24.↵
    Ontario Agency for Health Protection and Promotion (Public Health Ontario). SARS-CoV-2 (COVID-19 Virus) Variant of Concern (VoC) Screening and Genomic Sequencing for Surveillance. SARS-COV-2 VoC S-Gene Deletion Screen by Real-Time PCR 2021 [Available from: https://www.publichealthontario.ca/en/laboratory-services/test-information-index/covid-19-voc accessed 28 December 2021.
  25. 25.↵
    Government of Ontario. Getting the COVID-19 vaccine: Queen’s Printer for Ontario; [Available from: https://covid-19.ontario.ca/getting-covid-19-vaccine#which-vaccine-you-can-get accessed December 23 2021.
  26. 26.↵
    McGrath JM. Here’s Ontario’s booster-shot plan [internet]. Available at: https://www.tvo.org/article/heres-ontarios-booster-shot-plan [
  27. 27.↵
    Government of Ontario. Ontario’s Updated COVID-19 Vaccination Eligibility [Internet]: Queen’s Printer for Ontario; 2021 [Available from: https://news.ontario.ca/en/backgrounder/1000751/ontarios-updated-covid-19-vaccination-eligibility accessed January 25 2022.
  28. 28.↵
    Government of Ontario. Expanded Eligibility for Third Doses of the COVID-19 Vaccine [Internet]: Queen’s Printer for Ontario; 2021 [cited 2022 January 25]. Available from: https://news.ontario.ca/en/backgrounder/1000805/expanded-eligibility-for-third-doses-of-the-covid-19-vaccine.
  29. 29.↵
    Government of Ontario. Ontario Expanding Booster Eligibility to More Ontarians [Internet]: Queen’s Printer for Ontario; 2021 [cited 2022 January 25]. Available from: https://news.ontario.ca/en/release/1001100/ontario-expanding-booster-eligibility-to-more-ontarians.
  30. 30.↵
    Government of Ontario. Ontario Accelerating Booster Eligibility to Adults Aged 50+ [Internet]: Queen’s Printer for Ontario; 2021 [cited 2022 January 25]. Available from: https://news.ontario.ca/en/release/1001269/ontario-accelerating-booster-eligibility-to-adults-aged-50.
  31. 31.↵
    Government of Ontario. All Ontarians 18+ Eligible for COVID-19 Booster Appointments at Three-Month Interval [Internet]: Queen’s Printer for Ontario; 2021 [cited 2022 January 25]. Available from: https://news.ontario.ca/en/release/1001352/all-ontarians-18-eligible-for-covid-19-booster-appointments-at-three-month-interval.
  32. 32.↵
    Gao Y, Cai C, Grifoni A, et al. Ancestral SARS-CoV-2-specific T cells cross-recognize the Omicron variant. Nat Med 2022 doi: 10.1038/s41591-022-01700-x
    OpenUrlCrossRef
  33. 33.↵
    Wu M, Wall EC, Carr EJ, et al. Three-dose vaccination elicits neutralising antibodies against omicron. Lancet 2022 doi: 10.1016/S0140-6736(22)00092-7
    OpenUrlCrossRef
  34. 34.↵
    Garcia-Beltran WF, St. Denis Kj, Hoelzemer A, et al. mRNA-based COVID-19 vaccine boosters induce neutralizing immunity against SARS-CoV-2 Omicron variant. medRxiv 2021:2021.12.14.21267755. doi: 10.1101/2021.12.14.21267755
    OpenUrlAbstract/FREE Full Text
  35. 35.↵
    Pfizer Press Release. Pfizer and BioNTech Provide Update on Omicron Variant 2021 [cited 2021 22 December]. Available from: https://www.pfizer.com/news/press-release/press-release-detail/pfizer-and-biontech-provide-update-omicron-variant.
  36. 36.↵
    Muik A, Lui BG, Wallisch AK, et al. Neutralization of SARS-CoV-2 Omicron by BNT162b2 mRNA vaccine-elicited human sera. Science 2022:eabn7591. doi: 10.1126/science.abn7591 [published Online First: 2022/01/19]
    OpenUrlCrossRef
  37. 37.↵
    Redd AD, Nardin A, Kared H, et al. Minimal cross-over between mutations associated with Omicron variant of SARS-CoV-2 and CD8+ T cell epitopes identified in COVID-19 convalescent individuals. bioRxiv 2021:2021.12.06.471446. doi: 10.1101/2021.12.06.471446
    OpenUrlAbstract/FREE Full Text
  38. 38.↵
    UK Health Security Agency. SARS-CoV-2 variants of concern and variants under investigation in England. Technical briefing 34. 14 January 2022 [Available from: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1048395/technical-briefing-34-14-january-2022.pdf accessed 15 January 2022.
  39. 39.↵
    Jüni P, da Costa BR, Maltsev A, et al. Ontario dashboard. Science Briefs of the Ontario COVID-19 Science Advisory Table. 2021. https://doi.org/10.47326/ocsat.dashboard.2021.1.0.
  40. 40.↵
    Ontario Agency for Health Protection and Promotion (Public Health Ontario). Confirmed cases of COVID19 following vaccination in Ontario: December 14, 2020 to January 3 2022: Toronto, ON: Queen’s Printer for Ontario; 2022 [Available from: https://www.publichealthontario.ca/-/media/documents/ncov/epi/covid-19-epi-confirmed-cases-post-vaccination.pdf?sc_lang=en.
  41. 41.↵
    Lipsitch M, Krammer F, Regev-Yochay G, et al. SARS-CoV-2 breakthrough infections in vaccinated individuals: measurement, causes and impact. Nat Rev Immunol 2022;22(1):57–65. doi: 10.1038/s41577-021-00662-4
    OpenUrlCrossRef
  42. 42.↵
    Buchan SA, Seo CY, Johnson C, et al. Epidemiology of myocarditis and pericarditis following mRNA vaccines in Ontario, Canada: by vaccine product, schedule and interval. medRxiv 2021:2021.12.02.21267156. doi: 10.1101/2021.12.02.21267156
    OpenUrlAbstract/FREE Full Text
  43. 43.↵
    Ontario Ministry of Health. COVID-19 Vaccine Information Sheet (age 12+) 2021 [Available from: https://www.health.gov.on.ca/en/pro/programs/publichealth/coronavirus/docs/vaccine/COVID-19_vaccine_info_sheet.pdf accessed 22 December 2021.
  44. 44.↵
    Matytsin A. The Mask-Wearing Bias In The Estimates Of Vaccine Efficacy. medRxiv 2021:2021.10.19.21265093. doi: 10.1101/2021.10.19.21265093
    OpenUrlAbstract/FREE Full Text
  45. 45.↵
    Our World in Data. Coronavirus (COVID-19) Cases [Available from: https://ourworldindata.org/covid-cases accessed 30 December 2021.
  46. 46.↵
    León TM, Dorabawila V, Nelson L, et al. COVID-19 Cases and Hospitalizations by COVID-19 Vaccination Status and Previous COVID-19 Diagnosis — California and New York, May– November 2021. MMWR Morb Mortal Wkly Rep 2022;71:ePub: 19 January 2022. DOI: http://dx.doi.org/10.15585/mmwr.mm7104e1. doi: http://dx.doi.org/10.15585/mmwr.mm7104e1
  47. 47.↵
    Accorsi EK, Britton A, Fleming-Dutra KE, et al. Association Between 3 Doses of mRNA COVID-19 Vaccine and Symptomatic Infection Caused by the SARS-CoV-2 Omicron and Delta Variants. JAMA 2022:doi:10.1001/jama.2022.0470. doi: 10.1001/jama.2022.0470
    OpenUrlCrossRefPubMed
  48. 48.↵
    UK Health Security Agency. COVID-19 vaccine surveillance report - week 50 2022 [Available from: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1041593/Vaccine-surveillance-report-week-50.pdf accessed 24 December 2021.
  49. 49.↵
    UK Health Security Agency. COVID-19 vaccine surveillance report - week 51 2022 [Available from: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1043608/Vaccine_surveillance_report_-_week_51.pdf accessed 24 December 2021.
  50. 50.↵
    Glasziou P, McCaffery KJ, Cvejic E, et al. Testing behaviour may bias observational studies of vaccine effectiveness. medRxiv 2022:2022.01.17.22269450. doi: 10.1101/2022.01.17.22269450
    OpenUrlAbstract/FREE Full Text
  51. 51.↵
    Statens Serum Institut. Now, an Omicron variant, BA.2, accounts for almost half of all Danish Omicron-cases [Internet]. Denmark; 2022 Jan 20 [cited 2022 Jan 25]. Available from: https://en.ssi.dk/news/news/2022/omicron-variant-ba2-accounts-for-almost-half-of-all-danish-omicron-cases.
Back to top
Posted January 28, 2022.
Download PDF

Supplementary Material

Data/Code
Email
Effectiveness of COVID-19 vaccines against Omicron or Delta symptomatic infection and severe outcomes
Sarah A. Buchan, Hannah Chung, Kevin A. Brown, Peter C. Austin, Deshayne B. Fell, Jonathan B. Gubbay, Sharifa Nasreen, Kevin L. Schwartz, Maria E. Sundaram, Mina Tadrous, Kumanan Wilson, Sarah E. Wilson, Jeffrey C. Kwong
medRxiv 2021.12.30.21268565; doi: https://doi.org/10.1101/2021.12.30.21268565
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area