BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the Delta (B.1.617.2) variant in Qatar ==================================================================================================== * Patrick Tang * Mohammad R. Hasan * Hiam Chemaitelly * Hadi M. Yassine * Fatiha M. Benslimane * Hebah A. Al Khatib * Sawsan AlMukdad * Peter Coyle * Houssein H. Ayoub * Zaina Al Kanaani * Einas Al Kuwari * Andrew Jeremijenko * Anvar Hassan Kaleeckal * Ali Nizar Latif * Riyazuddin Mohammad Shaik * Hanan F. Abdul Rahim * Gheyath K. Nasrallah * Mohamed Ghaith Al Kuwari * Hamad Eid Al Romaihi * Adeel A. Butt * Mohamed H. Al-Thani * Abdullatif Al Khal * Roberto Bertollini * Laith J. Abu-Raddad ## Abstract The SARS-CoV-2 Delta (B.1.617.2) variant of concern is expanding globally. Here, we assess real-world effectiveness of the BNT162b2 (Pfizer-BioNTech) and mRNA-1273 (Moderna) vaccines against this variant in the population of Qatar, using a matched test-negative, case- control study design. BNT162b2 effectiveness against any Delta infection, symptomatic or asymptomatic, was 64.2% (95% CI: 38.1-80.1%) ≥14 days after the first dose and before the second dose, but was only 53.5% (95% CI: 43.9-61.4%) ≥14 days after the second dose, in a population in which a large proportion of fully vaccinated persons received their second dose several months earlier. Corresponding effectiveness measures for mRNA-1273 were 79.0% (95% CI: 58.9-90.1%) and 84.8% (95% CI: 75.9-90.8%), respectively. Effectiveness against any severe, critical, or fatal COVID-19 disease due to Delta was 89.7% (95% CI: 61.0-98.1%) for BNT162b2 and 100.0% (95% CI: 41.2-100.0%) for mRNA-1273, ≥14 days after the second dose. Both BNT162b2 and mRNA-1273 are highly effective in preventing Delta hospitalization and death, but less so in preventing infection, particularly for BNT162b2. Keywords * SARS-CoV-2 * epidemiology * vaccine * variant * infection * dose * case-control ## Introduction The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) Delta (B.1.617.2) variant of concern is expanding globally1. Appreciable community transmission of this variant was first detected in Qatar toward the end of March, 20212-4. While the incidence of Delta has been increasing, it remained relatively low. Though there has been a recent surge in cases, no evidence for a clear epidemic wave has materialized as of August 10, 2021. In contrast, the introduction of both the Alpha (B.1.1.7) and Beta (B.1.351) variants led to two rapid back-to-back SARS-CoV-2 waves earlier in 20212-6. The high Coronavirus Disease 2019 (COVID-19) vaccine coverage in Qatar at the present time may have slowed Delta transmission. As of August 10, 2021, 87.8% of persons ≥12 years of age have received at least one vaccine dose of either the BNT162b27(Pfizer-BioNTech) vaccine or the mRNA-12738 (Moderna) vaccine, and 73.8% have received both doses9. In the present study, we assessed real-world effectiveness of the BNT162b2 and mRNA-1273 vaccines against the Delta variant. ## Results ### Study population Between December 21, 2020 and July 21, 2021, 906,078 individuals in Qatar received at least one dose of BNT162b2, and 877,354 completed the two-dose regimen. The median date at first dose was April 18, 2021, and the median date at second dose was May 7, 2021. The median time elapsed between the first and second doses was 21 days (interquartile range (IQR): 21-22 days), and 97.7% of individuals received their second dose ≤30 days after the first dose. During the same time interval, 490,828 individuals received at least one dose of mRNA-1273, and 409,041 completed the two-dose regimen. The median date at first dose was April 18, 2021, and the median date at second dose was May 12, 2021. Median time elapsed between the first and second doses was 28 days (IQR: 28-31 days), and 74.6% of individuals received their second dose ≤30 days after the first dose. As a consequence of the schedule of arriving vaccine shipments, BNT162b2 vaccine coverage increased incrementally and steadily from December 2020 and up to the present. Meanwhile, the increases in mRNA-1273 vaccine coverage occurred in specific times following arrival of large shipments, and was not appreciable before March of 2021. Supplementary Data 1-3 provide flowcharts describing the population selection process for investigating and estimating vaccine effectiveness against Delta for the BNT162b2 vaccine (Supplementary Data 1), the mRNA-1273 vaccine (Supplementary Data 2), and any vaccination with either BNT162b2 or mRNA-1273 (Supplementary Data 3). Demographic characteristics of samples used to estimate vaccine effectiveness ≥14 days after the first dose and ≥14 days after the second dose are presented in Tables 1 and 2, respectively. Median age in the study samples was 31-32 years. Qatar has unusually young, diverse demographics, in that only 9% of its residents are ≥50 years of age, and 89% are expatriates from over 150 countries10,11. View this table: [Table 1.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/T1) Table 1. Demographic characteristics of cases (PCR-positive for SARS-CoV-2 Delta variant) and controls (PCR-negative) in samples used in the ≥14-days-after-first-dose analysis of vaccine effectiveness of A) BNT162b2, B) mRNA-1273, and C) BNT162b2 or mRNA-1273. View this table: [Table 2.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/T2) Table 2. Demographic characteristics of cases (PCR-positive for SARS-CoV-2 Delta variant) and controls (PCR-negative) in samples used in the ≥14-days-after-second-dose analysis of vaccine effectiveness of A) BNT162b2, B) mRNA-1273, and C) BNT162b2 or mRNA-1273. ### Delta vaccine-breakthrough infections As of the end of the study, July 21, 2021, 54 and 249 Delta breakthrough infections had been recorded among those who received either one or two doses of BNT162b2, respectively, and 27 and 26 breakthrough infections had been recorded among those who received mRNA-1273, respectively. Also, as of July 21, 2021, 3 and 4 severe Delta COVID-19 disease cases (acute-care hospitalizations12; Methods) had been recorded among those who received either one or two doses of BNT162b2, respectively, and 3 severe disease cases had been recorded among those who received only one dose of mRNA-1273. No severe Delta disease cases were recorded among those who received two doses of mRNA-1273. Meanwhile, 1 critical Delta COVID-19 disease case (ICU-care hospitalization12; Methods) had been recorded among those who received two doses of BNT162b2. No critical disease cases were recorded among those who received only one dose of BNT162b2, or among those who received one or two doses of mRNA-1273. No fatal Delta COVID-19 disease cases (COVID-19 deaths13; Methods) were recorded among those who received either vaccine. ### Vaccine effectiveness ≥14 days after the first dose Estimated BNT162b2 effectiveness against infection with Delta, defined as a polymerase chain reaction (PCR)-positive swab with the Delta variant, regardless of the reason for PCR testing or presence of symptoms (Methods), was 64.2% (95% confidence interval (CI): 38.1-80.1%) 14 or more days after the first dose, but before receiving the second dose (Table 3). The corresponding effectiveness for mRNA-1273 was 79.0% (95% CI: 58.9-90.1%), and for vaccination with either BNT162b2 or mRNA-1273, it was 68.9% (95% CI: 52.7-80.1%). View this table: [Table 3.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/T3) Table 3. Effectiveness of the BNT162b2 and mRNA-1273 vaccines against the Delta variant ≥14 days after the first dose and ≥14 days after the second dose. Estimated vaccine effectiveness against any severe12, critical12, or fatal13 COVID-19 disease due to any Delta infection (Methods), 14 or more days after the first dose, but before receiving the second dose, was 100% for BNT162b2, mRNA-1273, and either BNT162b2 or mRNA-1273, but with very wide 95% confidence intervals due to the relatively small number of severe, critical, and fatal disease cases in this analysis (Table 3). ### Vaccine effectiveness ≥14 days after the second dose Estimated BNT162b2 effectiveness against infection with Delta was 53.5% (95% CI: 43.9- 61.4%) 14 or more days after the second dose (Table 3). The corresponding effectiveness for mRNA-1273 was 84.8% (95% CI: 75.9-90.8%), and for vaccination with either BNT162b2 or mRNA-1273, it was 57.2% (95% CI: 48.9-64.1%). Estimated BNT162b2 effectiveness against any severe12, critical12, or fatal13 COVID-19 disease due to any Delta infection was 89.7% (95% CI: 61.0-98.1%) 14 or more days after the second dose (Table 3). The corresponding effectiveness for mRNA-1273 was 100.0% (95% CI: 41.2- 100.0%), and for vaccination with either BNT162b2 or mRNA-1273, it was 92.6% (95% CI: 72.7-98.6%). ### Additional analyses Sensitivity analyses adjusting for sex, age, nationality, reason for PCR testing, and calendar week of PCR test in logistic regression analysis confirmed main analysis results, but with slightly higher estimated effectiveness (Table 4). View this table: [Table 4.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/T4) Table 4. Sensitivity analyses for effectiveness of the BNT162b2 and mRNA-1273 vaccines against the Delta variant ≥14 days after the first dose and ≥14 days after the second dose, adjusting for sex, age, nationality, reason for PCR testing, and calendar week in logistic regression analysis. An additional analysis estimated BNT162b2 effectiveness against symptomatic Delta infection at 56.1% (95% CI: 41.4-67.2%) 14 or more days after the second dose (Table 5). The corresponding effectiveness for mRNA-1273 was 85.8% (95% CI: 70.6-93.9%), and for vaccination with either BNT162b2 or mRNA-1273, it was 62.0% (95% CI: 50.0-71.1%). View this table: [Table 5.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/T5) Table 5. Effectiveness of the BNT162b2 and mRNA-1273 vaccines against symptomatic and asymptomatic infection with the Delta variant ≥14 days after the first dose and ≥14 days after the second dose. Symptomatic infection was defined as a PCR-positive test conducted because of clinical suspicion due to presence of symptoms compatible with a respiratory tract infection. An additional analysis estimated BNT162b2 effectiveness against asymptomatic Delta infection at 35.9% (95% CI: 11.1-53.9%) 14 or more days after the second dose (Table 5). The corresponding effectiveness for mRNA-1273 was 80.2% (95% CI: 54.2-92.6%), and for vaccination with either BNT162b2 or mRNA-1273, it was 40.0% (95% CI: 18.2-56.1%). Asymptomatic infection was defined as a PCR-positive test conducted with no reported presence of symptoms compatible with a respiratory tract infection, that is, strictly, the PCR testing was done as only part of a survey, for pre-travel requirement, or at port of entry upon arrival into the country10,14. ## Discussion Both the BNT162b2 and mRNA-1273 vaccines demonstrated robust effectiveness (≥90%) against hospitalization and death due to infection with the Delta variant, confirming recently announced estimates from the United Kingdom (UK)15 and Israel16. Although there were many breakthrough infections, especially for BNT162b2, severe or critical COVD-19 disease cases among vaccinated persons were rare. Among those fully vaccinated with BNT162b2, there were only 4 severe disease cases and 1 critical disease case due to Delta, while for mRNA-1273, there were only 3 severe disease cases and no critical disease cases. No COVID-19 deaths due to Delta were recorded in a person vaccinated with either vaccine. BNT162b2 effectiveness against any infection with Delta, symptomatic or asymptomatic, 14 or more days after the first dose, was 64.2%, compared to 46.5%17 against Beta (B.1.351) and 65.5%17 against Alpha (B.1.1.7), in the same population of Qatar. This result is consistent with existing evidence suggesting that Beta is the most immune-evasive variant of the known variants of concern18,19. However, BNT162b2 effectiveness against Delta 14 or more days after the second dose was only 53.5%, compared to 75.0%5,17 against Beta and 89.5%5,17 against Alpha. Strikingly, estimated BNT162b2 effectiveness against Delta 14 or more days after the first dose, or 14 or more days after the second dose, were statistically similar. Emerging evidence suggests significant waning of BNT162b2 effectiveness over time20-22. Effectiveness against Beta was estimated at a time when nearly all persons in Qatar were newly vaccinated with BNT162b25,17, but effectiveness against Delta was estimated (in the present study) at a time when a large proportion of those BNT162b2 vaccinated had received their second dose several months earlier. The unexpectedly low effectiveness against Delta among fully vaccinated persons may thus reflect some waning of BNT162b2 protection over time. This explanation is consistent with the pattern seen in emerging effectiveness estimates against Delta in other countries. Our estimate of 53.5% among fully vaccinated persons is lower than that found in the UK23,24 and Canada25, where effectiveness was estimated at >75%, but higher than that in Israel at only 39%16 and the United States (USA) at 42%26. With the delayed second dose in the UK and Canada, most BNT162b2-vaccinated persons received their second dose three months or so more recently than in Israel, USA, and Qatar, where the second dose was administered three weeks after the first dose. The lower effectiveness in Israel, USA, and Qatar may thus reflect waning of vaccine protection for those who received their second dose by end of 2020 or early 2021. Qatar started its mass vaccination campaign with BNT162b2 shortly after that of Israel and the USA. Another factor may also help to explain this low effectiveness. Public health restrictions have gradually been easing in Qatar over the last few weeks, coinciding with the period during which Delta incidence has been slowly increasing. Restrictions, however, have been eased differently for vaccinated and unvaccinated persons. Many social, work, and travel activities at present require evidence of vaccination (a “health pass”) that is administered through a mandatory mobile app (the Ehteraz app). Vaccinated persons presumably have a higher social contact rate than unvaccinated persons, and may have also reduced their adherence to safety measures, such as protective masks, with the perception of vaccine protection27-29. Such risk compensation may be even higher with increasing time since receiving the second dose, leading to progressive normalization of behavior28-30. Risk of exposure to the virus could thus be higher among vaccinated persons than among unvaccinated persons, thereby diminishing the observed real- world vaccine effectiveness relative to the actual biological vaccine effectiveness. mRNA-1273 effectiveness against infection with Delta was higher than that of BNT162b2, consistent with evidence suggesting that mRNA-1273 induces stronger immune response and protection6,31-33. mRNA-1273 effectiveness against Delta, 14 or more days after the first dose, was 79.0%, compared to 61.3%6 against Beta and 88.1%6 against Alpha, in the same population in Qatar. This result is also consistent with Beta’s being the most immune-evasive variant18,19. However, mRNA-1273 effectiveness against Delta, 14 or more days after the second dose, was only 84.8%, compared to 96.4%6 against Beta and 100%6 against Alpha. The same factors that may explain the low BNT162b2 effectiveness against Delta among fully vaccinated persons may also explain the less-than-expected mRNA-1273 effectiveness against Delta among fully vaccinated persons. However, there has been less time for waning of vaccine immunity for mRNA-1273, as this vaccine was incorporated into the national immunization campaign nearly three months after BNT162b25,6,17. There was evidence for a gradient in vaccine effectiveness by appearance of symptoms, that is, greater protection against more symptomatic or severe infections, as observed earlier for BNT162b2 and mRNA-1273 effectiveness against the Alpha and Beta variants5,6,17,25. This study has limitations. Estimated effectiveness against severe, critical, or fatal COVID-19 disease had wider 95% confidence intervals than that against infection, as a consequence of the smaller number of such cases in the young population of Qatar10,34. Data on co-morbid conditions were not available; therefore, they could not be factored explicitly in our analysis. However, adjusting for age may have served as a proxy given that co-morbidities are associated with older age. Furthermore, with the young population of Qatar10,11, we anticipate that only a small proportion of the study population may have had serious co-morbid conditions. Accordingly, our findings may not be generalizable to other settings where the elderly population constitutes a sizable proportion of the population. Effectiveness was assessed using an observational test-negative case-control study design35,36, rather than a randomized clinical trial design where cohorts of vaccinated and unvaccinated individuals were being followed up. However, the cohort study design applied to the same population of Qatar yielded earlier similar findings to the test-negative case-control study design5,6, supporting the validity of this standard approach in assessing vaccine effectiveness for respiratory tract infections35,36. In conclusion, both the BNT162b2 and mRNA-1273 vaccines are highly effective in preventing hospitalization and death due to infection with the Delta variant. However, effectiveness against infection was considerably lower than that against serious COVID-19 disease, particularly for the BNT162b2 vaccine. The reasons for the inferior protection against infection remain to be determined, and may not necessarily relate to immune evasion by the Delta variant. The lower effectiveness may reflect some waning of BNT162b2 vaccine protection over time, or higher risk of exposure to the virus among vaccinated persons compared to unvaccinated persons, due to higher social contact rate and less adherence to safety measures. ## Data Availability The dataset of this study is a property of the Qatar Ministry of Public Health that was provided to the researchers through a restricted-access agreement that prevents sharing the dataset with a third party or publicly. Future access to this dataset can be considered through a direct application for data access to Her Excellency the Minister of Public Health ([https://www.moph.gov.qa/english/Pages/default.aspx](https://www.moph.gov.qa/english/Pages/default.aspx)). Aggregate data are available within the manuscript and its Supplementary information. ## Author contributions PT and MRH conducted the multiplex, RT-qPCR variant screening and viral genome sequencing. HC co-designed the study, performed the statistical analyses, and co-wrote the first draft of the article. LJA conceived and co-designed the study, led the statistical analyses, and co- wrote the first draft of the article. HY, FMB, and HAK conducted viral genome sequencing. All authors contributed to data collection and acquisition, database development, discussion and interpretation of the results, and to the writing of the manuscript. All authors have read and approved the final manuscript. ## Competing interests Dr. Butt has received institutional grant funding from Gilead Sciences unrelated to the work presented in this paper. Otherwise, we declare no competing interests. ## Methods ### Data sources, study population, and study design This study was conducted in the resident population of Qatar. Coronavirus Disease 2019 (COVID-19) laboratory testing, vaccination, clinical infection data, and related demographic details were extracted from the integrated nationwide digital-health information platform that hosts the national, federated SARS-CoV-2 databases. These databases are complete and have captured all SARS-CoV-2-related data since epidemic onset. Nearly all individuals were vaccinated (free of charge) in Qatar and not elsewhere. In rare situations in which an individual received COVID-19 vaccination outside Qatar, the individual’s vaccination details were still recorded in the health system at the port of entry (airport) upon return to Qatar, in order to fulfill national requirements and to benefit from privileges associated with vaccination, such as quarantine exemption. Vaccine effectiveness was estimated using the test-negative, case-control study design, a standard design for assessing vaccine effectiveness against influenza35,36. Key to this design is the control of bias arising from misclassification of infection and differences in health care- seeking behavior between vaccinated and unvaccinated individuals35,36. Cases and controls were matched one-to-one by sex, 10-year age group, nationality, reason for SARS-CoV-2 polymerase chain reaction (PCR) testing, and calendar week of PCR test. Matching of cases and controls was performed to control for known differences in the risk of exposure to infection in Qatar10,40-42. Effectiveness was estimated against documented infection (defined as a PCR-positive swab regardless of the reason for PCR testing or presence of symptoms) with the Delta (B.1.617.2) variant, as well as against severe, critical, or fatal COVID-19 disease due to Delta infection. Classification of COVID-19 case severity (acute-care hospitalizations)12, criticality (ICU hospitalizations)12, and fatality13 followed the World Health Organization guidelines, and assessments were made by trained medical personnel using individual chart reviews (see below). All records of PCR testing for those vaccinated and unvaccinated during the study duration were examined. All persons who received mixed vaccines, or who received a vaccine other than BNT162b2 or mRNA-1273 were excluded. Every case that met the inclusion criteria (a Delta case) and that could be matched to a control was included in the analysis. Both PCR-test outcomes and vaccination status were ascertained at the time of the PCR test. Each person that had a positive PCR test result and hospital admission was subject to an infection severity assessment every three days until discharge or death. Individuals who progressed to COVID-19 disease between the time of the positive PCR test result and the end of the study were classified based on their worst outcome, starting with death13, followed by critical disease12, and then severe disease12 (see below). The study was approved by the Hamad Medical Corporation and Weill Cornell Medicine-Qatar Institutional Review Boards with waiver of informed consent. The STROBE checklist can be found in Supplementary Table 1. ### COVID-19 severity, criticality, and fatality classification Severe COVID-19 disease was defined per WHO classification as a SARS-CoV-2 infected person with “oxygen saturation of <90% on room air, and/or respiratory rate of >30 breaths/minute in adults and children >5 years old (or ≥60 breaths/minute in children <2 months old or ≥50 breaths/minute in children 2–11 months old or ≥40 breaths/minute in children 1–5 years old), and/or signs of severe respiratory distress (accessory muscle use and inability to complete full sentences, and, in children, very severe chest wall indrawing, grunting, central cyanosis, or presence of any other general danger signs)”37. Detailed WHO criteria for classifying SARS-CoV-2 infection severity can be found in the WHO technical report37. Critical COVID-19 disease was defined per WHO classification as a SARS-CoV-2 infected person with “acute respiratory distress syndrome, sepsis, septic shock, or other conditions that would normally require the provision of life sustaining therapies such as mechanical ventilation (invasive or non-invasive) or vasopressor therapy”37. Detailed WHO criteria for classifying SARS-CoV-2 infection criticality can be found in the WHO technical report37. COVID-19 death was defined per WHO classification as “a death resulting from a clinically compatible illness, in a probable or confirmed COVID-19 case, unless there is a clear alternative cause of death that cannot be related to COVID-19 disease (e.g. trauma). There should be no period of complete recovery from COVID-19 between illness and death. A death due to COVID- 19 may not be attributed to another disease (e.g. cancer) and should be counted independently of preexisting conditions that are suspected of triggering a severe course of COVID-19”. Detailed WHO criteria for classifying COVID-19 death can be found in the WHO technical report38. ### Classification of infections by variant type Surveillance for SARS-CoV-2 variants in Qatar is based on viral genome sequencing and multiplex, real-time reverse-transcription PCR (RT-qPCR) variant screening44 of random positive clinical samples2-6, and complemented by deep sequencing of wastewater samples2. The ascertainment of the B.1.617.2 (Delta) cases in this study was based on the results of the weekly RT-qPCR genotyping of the positive clinical samples2,4. Between March 23, 2021 and July 21, 2021, RT-qPCR genotyping identified 5,394 (50.6%) B.1.351-like cases, 3,046 (28.6%) B.1.1.7- like cases, 2,175 (20.4%) “other” variant cases, and 41 (0.4%) B.1.375-like and B.1.258-like cases in 10,656 randomly collected SARS-CoV-2-positive specimens2,4. The accuracy of the RT-qPCR genotyping was verified against either Sanger sequencing of the receptor-binding domain (RBD) of SARS-CoV-2 surface glycoprotein (S) gene, or by viral whole-genome sequencing on a Nanopore GridION sequencing device. From 236 random samples (27 B.1.1.7-like, 186 B.1.351/P.1-like, and 23 “other” variants), the PCR genotyping results for B.1.1.7-like, B.1.351/P.1-like, and ‘other’ variants were in 88.8% (23 out of 27), 99.5% (185 out of 186), and 100% (23 out of 23) agreement with the SARS-CoV-2 lineages assigned by sequencing. Within the “other” variant category, Sanger sequencing and/or Illumina sequencing of the RBD of SARS-CoV-2 spike gene on 450 random samples confirmed that 433 (96.2%) were B.1.617.2 cases, 8 (1.8%) were B.1.617.1 cases, 3 (0.7%) were B.1 cases, 1 (0.2%) was a P.1 case, and 1 (0.2%) was a B.1.617.3 case, with 5 (1.1%) samples failing sequencing2,4. Accordingly, a Delta case was proxied as any “other” case identified through the RT-qPCR based variant screening. ### Laboratory methods Nasopharyngeal and/or oropharyngeal swabs (Huachenyang Technology, China) were collected for PCR testing and placed in Universal Transport Medium (UTM). Aliquots of UTM were: extracted on a QIAsymphony platform (QIAGEN, USA) and tested with real-time reverse- transcription PCR (RT-qPCR) using TaqPath™ COVID-19 Combo Kits (Thermo Fisher Scientific, USA) on an ABI 7500 FAST (ThermoFisher, USA); tested directly on the Cepheid GeneXpert system using the Xpert Xpress SARS-CoV-2 (Cepheid, USA); or loaded directly into a Roche cobas® 6800 system and assayed with a cobas® SARS-CoV-2 Test (Roche, Switzerland). The first assay targets the viral S, N, and ORF1ab gene regions. The second targets the viral N and E-gene regions, and the third targets the ORF1ab and E-gene regions. All tests were conducted at the HMC Central Laboratory or Sidra Medicine Laboratory, following standardized protocols. ### Statistical analysis Descriptive statistics (frequency distributions and measures of central tendency) were used to characterize the study samples. The odds ratio, comparing odds of vaccination among cases to that among controls, and its associated 95% confidence interval (CI) were calculated using the exact method. Confidence intervals were not adjusted for multiplicity. Interactions were not investigated. Vaccine effectiveness at different time frames and its associated 95% CI were then calculated by applying the following equation35,36: ![Formula][1] Statistical analyses were conducted in STATA/SE version 17.045. ### Additional analyses To ensure that vaccine effectiveness estimates were not biased by epidemic phase35,46, the gradual roll-out of vaccination during the study35,46, and other confounders47,48, a sensitivity analysis was conducted by adjusting for the matching factors in logistic regression, that is sex, age, nationality, reason for PCR testing, and calendar week of PCR test (Table 4). Additional analyses were conducted to estimate vaccine effectiveness against symptomatic infection, defined as a PCR-positive test conducted because of clinical suspicion due to presence of symptoms compatible with a respiratory tract infection, and against asymptomatic infection, defined as a PCR-positive test conducted with no reported presence of symptoms compatible with a respiratory tract infection, that is the PCR testing was done as part of a survey, for pre- travel requirement, or at port of entry into the country. ## Data availability The dataset of this study is a property of the Qatar Ministry of Public Health that was provided to the researchers through a restricted-access agreement that prevents sharing the dataset with a third party or publicly. Future access to this dataset can be considered through a direct application for data access to Her Excellency the Minister of Public Health ([https://www.moph.gov.qa/english/Pages/default.aspx](http://www.moph.gov.qa/english/Pages/default.aspx)). Aggregate data are available within the manuscript and its Supplementary information. ## Supplementary Material ![Supplementary Data 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/08/11/2021.08.11.21261885/F1.medium.gif) [Supplementary Data 1.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/F1) Supplementary Data 1. Flowchart describing the population selection process for investigating BNT162b2 vaccine effectiveness against infection with the SARS-CoV-2 Delta variant. ![Supplementary Data 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/08/11/2021.08.11.21261885/F2.medium.gif) [Supplementary Data 2.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/F2) Supplementary Data 2. Flowchart describing the population selection process for investigating mRNA-1273 vaccine effectiveness against infection with the SARS-CoV-2 Delta variant. ![Supplementary Data 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/08/11/2021.08.11.21261885/F3.medium.gif) [Supplementary Data 3.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/F3) Supplementary Data 3. Flowchart describing the population selection process for investigating the BNT162b2 and mRNA-1273 vaccines effectiveness against infection with the SARS-CoV-2 Delta variant. View this table: [Supplementary Table 1.](http://medrxiv.org/content/early/2021/08/11/2021.08.11.21261885/T6) Supplementary Table 1. STROBE checklist for case-control studies ## Acknowledgements We acknowledge the many dedicated individuals at Hamad Medical Corporation, the Ministry of Public Health, the Primary Health Care Corporation, Qatar Biobank, Sidra Medicine, and Weill Cornell Medicine for their diligent efforts and contributions to make this study possible. The authors are grateful for institutional salary support from the Biomedical Research Program and the Biostatistics, Epidemiology, and Biomathematics Research Core, both at Weill Cornell Medicine-Qatar, as well as for institutional salary support provided by the Ministry of Public Health and Hamad Medical Corporation. The authors are also grateful for the Qatar Genome Programme for institutional support for the reagents needed for the viral genome sequencing. The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the article. Statements made herein are solely the responsibility of the authors. ## Footnotes * # Authors are joint first authors in this study. * Received August 11, 2021. * Revision received August 11, 2021. * Accepted August 11, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. 1.World Health Organization. Tracking SARS-CoV-2 variants. Available from: [https://www.who.int/en/activities/tracking-SARS-CoV-2-variants/](https://www.who.int/en/activities/tracking-SARS-CoV-2-variants/). Accessed on: June 5, 2021. (2021). 2. 2.National Project of Surveillance for Variants of Concern and Viral Genome Sequencing. Qatar viral genome sequencing data. Data on randomly collected samples. [https://www.gisaid.org/phylodynamics/global/nextstrain/](https://www.gisaid.org/phylodynamics/global/nextstrain/). (2021). 3. 3.Benslimane, F.M., et al. One year of SARS-CoV-2: Genomic characterization of COVID-19 outbreak in Qatar. medRxiv, 2021.2005.2019.21257433 (2021). 4. 4.Hasan, M.R., et al. Real-Time SARS-CoV-2 Genotyping by High-Throughput Multiplex PCR Reveals the Epidemiology of the Variants of Concern in Qatar. medRxiv, 2021.2007.2018.21260718 (2021). 5. 5.Abu-Raddad, L.J., Chemaitelly, H., Butt, A.A. & National Study Group for Covid-19 Vaccination. Effectiveness of the BNT162b2 Covid-19 Vaccine against the B.1.1.7 and B.1.351 Variants. N Engl J Med (2021). 6. 6.Chemaitelly, H., et al. mRNA-1273 COVID-19 vaccine effectiveness against the B.1.1.7 and B.1.351 variants and severe COVID-19 disease in Qatar. Nat Med (2021). 7. 7.Polack, F.P., et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N Engl J Med (2020). 8. 8.Baden, L.R., et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med 384, 403–416 (2021). [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2035389&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F08%2F11%2F2021.08.11.21261885.atom) 9. 9.Ministry of Public Health. National Covid-19 Vaccination Program Data. [https://covid19.moph.gov.qa/EN/Pages/Vaccination-Program-Data.aspx](https://covid19.moph.gov.qa/EN/Pages/Vaccination-Program-Data.aspx). Access date August 2, 2021. (2021). 10. 10.Abu-Raddad, L.J., et al. Characterizing the Qatar advanced-phase SARS-CoV-2 epidemic. Scientific Reports 11, 6233 (2021). 11. 11.Planning and Statistics Authority-State of Qatar. Qatar Monthly Statistics. Available from: [https://www.psa.gov.qa/en/pages/default.aspx](https://www.psa.gov.qa/en/pages/default.aspx). Accessed on: May 26, 2020. (2020). 12. 12.World Health Organization. COVID-19 clinical management: living guidance. Available from: [https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-1](https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-1). Accessed on: May 15, 2021. (2021). 13. 13.World Health Organization. International guidelines for certification and classification (coding) of COVID-19 as cause of death. Available from: [https://www.who.int/classifications/icd/Guidelines\_Cause\_of\_Death\_COVID-19-20200420-EN.pdf?ua=1](https://www.who.int/classifications/icd/Guidelines\_Cause_of_Death_COVID-19-20200420-EN.pdf?ua=1). Document Number: WHO/HQ/DDI/DNA/CAT. Accessed on May 15, 2021. (2020). 14. 14.Bertollini, R., et al. Associations of Vaccination and of Prior Infection With Positive PCR Test Results for SARS-CoV-2 in Airline Passengers Arriving in Qatar. JAMA (2021). 15. 15.Stowe, J., et al. Effectiveness of COVID-19 vaccines against hospital admission with the Delta (B.1.617.2) variant. [https://khub.net/web/phe-national/public-library/-/document\_library/v2WsRK3ZlEig/view\_file/479607329?\_com\_liferay\_document\_library\_web\_portlet\_DLPortlet\_INSTANCE\_v2WsRK3ZlEig\_redirect=https%3A%2F%2Fkhub.net%3A443%2Fweb%2Fphe-national%2Fpublic-library%2F-%](https://khub.net/web/phe-national/public-library/-/document\_library/v2WsRK3ZlEig/view\_file/479607329?\_com\_liferay\_document\_library\_web\_portlet\_DLPortlet_INSTANCE_v2WsRK3ZlEig_redirect=https%3A%2F%2Fkhub.net%3A443%2Fweb%2Fphe-national%2Fpublic-library%2F). (2021). 16. 16.Israel’s Ministry of Health. COVID-19 vaccine effectiveness against the Delta variant. Israel’s Ministry of Health report. [https://www.gov.il/BlobFolder/reports/vaccine-efficacy-safety-follow-up-committee/he/files\_publications\_corona\_two-dose-vaccination-data.pdf](https://www.gov.il/BlobFolder/reports/vaccine-efficacy-safety-follow-up-committee/he/files_publications_corona_two-dose-vaccination-data.pdf). (2021). 17. 17.Abu-Raddad, L.J., et al. Pfizer-BioNTech mRNA BNT162b2 Covid-19 vaccine protection against variants of concern after one versus two doses. J Travel Med (2021). 18. 18.Wang, P., et al. Antibody resistance of SARS-CoV-2 variants B.1.351 and B.1.1.7. Nature (2021). 19. 19.Planas, D., et al. Sensitivity of infectious SARS-CoV-2 B.1.1.7 and B.1.351 variants to neutralizing antibodies. Nat Med (2021). 20. 20.Israel, A., et al. Elapsed time since BNT162b2 vaccine and risk of SARS-CoV-2 infection in a large cohort. medRxiv, 2021.2008.2003.21261496 (2021). 21. 21.Thomas, S.J., et al. Six Month Safety and Efficacy of the BNT162b2 mRNA COVID-19 Vaccine. medRxiv, 2021.2007.2028.21261159 (2021). 22. 22.Mizrahi, B., et al. Correlation of SARS-CoV-2 Breakthrough Infections to Time-from-vaccine; Preliminary Study. medRxiv, 2021.2007.2029.21261317 (2021). 23. 23.Lopez Bernal, J., et al. Effectiveness of Covid-19 Vaccines against the B.1.617.2 (Delta) Variant. N Engl J Med (2021). 24. 24.Sheikh, A., McMenamin, J., Taylor, B. & Robertson, C. SARS-CoV-2 Delta VOC in Scotland: demographics, risk of hospital admission, and vaccine effectiveness. The Lancet 397, 2461–2462 (2021). 25. 25.Nasreen, S., et al. Effectiveness of COVID-19 vaccines against variants of concern, Canada. medRxiv, 2021.2006.2028.21259420 (2021). 26. 26.Puranik, A., et al. Comparison of two highly-effective mRNA vaccines for COVID-19 during periods of Alpha and Delta variant prevalence. medRxiv, 2021.2008.2006.21261707 (2021). 27. 27.Makhoul M., et al. Epidemiological impact of SARS-CoV-2 vaccination: Mathematical modeling analyses. Vaccines 8(2020). 28. 28.Usherwood, T., LaJoie, Z. & Srivastava, V. A model and predictions for COVID-19 considering population behavior and vaccination. Scientific Reports 11, 12051 (2021). 29. 29.Andersson, O., Campos-Mercade, P., Meier, A.N. & Wengström, E. Anticipation of COVID-19 Vaccines Reduces Social Distancing. [https://papers.ssrn.com/sol3/papers.cfm?abstract\_id=3765329](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3765329). SSRN (2021). 30. 30.Cassell, M.M., Halperin, D.T., Shelton, J.D. & Stanton, D. Risk compensation: the Achilles’ heel of innovations in HIV prevention? BMJ 332, 605–607 (2006). [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMzIvNzU0MS82MDUiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wOC8xMS8yMDIxLjA4LjExLjIxMjYxODg1LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 31. 31.Abu-Raddad, L.J., et al. Effect of vaccination and of prior infection on infectiousness of vaccine breakthrough infections and reinfections. medRxiv, 2021.2007.2028.21261086 (2021). 32. 32.Abu-Raddad, L.J., et al. Protection afforded by the BNT162b2 and mRNA-1273 COVID-19 vaccines in fully vaccinated cohorts with and without prior infection. medRxiv, 2021.2007.2025.21261093 (2021). 33. 33.Khoury, D.S., et al. Neutralizing antibody levels are highly predictive of immune protection from symptomatic SARS-CoV-2 infection. Nat Med 27, 1205–1211 (2021). 34. 34.Seedat, S., et al. SARS-CoV-2 infection hospitalization, severity, criticality, and fatality rates. medRxiv 2020.11.29.20240416 (2020). 35. 35.Jackson, M.L. & Nelson, J.C. The test-negative design for estimating influenza vaccine effectiveness. Vaccine 31, 2165–2168 (2013). [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.vaccine.2013.02.053&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23499601&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F08%2F11%2F2021.08.11.21261885.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000318329400010&link_type=ISI) 36. 36.Verani, J.R., et al. Case-control vaccine effectiveness studies: Preparation, design, and enrollment of cases and controls. Vaccine 35, 3295–3302 (2017). 37. 37.World Health Organization. COVID-19 clinical management: living guidance. Available from: [https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-1](https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-1). Accessed on: May 15 2021. (2021). 38. 38.World Health Organization. International guidelines for certification and classification (coding) of COVID-19 as cause of death. Available from: [https://www.who.int/classifications/icd/Guidelines\_Cause\_of\_Death\_COVID-19-20200420-EN.pdf?ua=1](https://www.who.int/classifications/icd/Guidelines\_Cause_of_Death_COVID-19-20200420-EN.pdf?ua=1). Document Number: WHO/HQ/DDI/DNA/CAT. Accessed on May 31, 2021. (2021). 39. 39.Ayoub, H.H., et al. Mathematical modeling of the SARS-CoV-2 epidemic in Qatar and its impact on the national response to COVID-19. J Glob Health 11, 05005 (2021). 40. 40.Coyle, P.V., et al. SARS-CoV-2 seroprevalence in the urban population of Qatar: An analysis of antibody testing on a sample of 112,941 individuals. iScience, 102646 (2021). 41. 41.Al-Thani, M.H., et al. SARS-CoV-2 infection is at herd immunity in the majority segment of the population of Qatar. Open Forum Infectious Diseases (2021). 42. 42.Jeremijenko, A., et al. Herd Immunity against Severe Acute Respiratory Syndrome Coronavirus 2 Infection in 10 Communities, Qatar. Emerg Infect Dis 27, 1343–1352 (2021). 43. 43.Abu-Raddad, L.J., et al. COVID-19 risk score as a public health tool to guide targeted testing: A demonstration study in Qatar. medRxiv, 2021.2003.2006.21252601 (2021). 44. 44.Vogels, C., Fauver, J. & Grubaugh, N. Multiplexed RT-qPCR to screen for SARS-COV-2 B.1.1.7, B.1.351, and P.1 variants of concern V.3. dx.doi.org/10.17504/protocols.io.br9vm966. (2021). [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.17504/protocols.io.br9vm966&link_type=DOI) 45. 45.StataCorp. Stata Statistical Software: Release 17. College Station, TX: StataCorp LLC. (2021). 46. 46.Jacoby, P. & Kelly, H. Is it necessary to adjust for calendar time in a test negative design?: Responding to: Jackson ML, Nelson JC. The test negative design for estimating influenza vaccine effectiveness. Vaccine 2013;31(April (17)):2165-8. Vaccine 32, 2942 (2014). 47. 47.Pearce, N. Analysis of matched case-control studies. BMJ 352, i969 (2016). [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE2OiIzNTIvZmViMjVfNi9pOTY5IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDgvMTEvMjAyMS4wOC4xMS4yMTI2MTg4NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 48. 48.Rothman, K.J., Greenland, S. & Lash, T.L. Modern epidemiology, (Wolters Kluwer Health/Lippincott Williams & Wilkins, Philadelphia, 2008). [1]: /embed/graphic-6.gif