Intended for healthcare professionals

CCBYNC Open access
Research

Effectiveness of mRNA vaccines and waning of protection against SARS-CoV-2 infection and severe covid-19 during predominant circulation of the delta variant in Italy: retrospective cohort study

BMJ 2022; 376 doi: https://doi.org/10.1136/bmj-2021-069052 (Published 10 February 2022) Cite this as: BMJ 2022;376:e069052

Read our latest coverage of the coronavirus pandemic

  1. Massimo Fabiani, researcher1,
  2. Maria Puopolo, researcher1,
  3. Cristina Morciano, researcher1,
  4. Matteo Spuri, research assistant1,
  5. Stefania Spila Alegiani, researcher1,
  6. Antonietta Filia, researcher1,
  7. Fortunato D’Ancona, researcher1,
  8. Martina Del Manso, researcher1,
  9. Flavia Riccardo, researcher1,
  10. Marco Tallon, analytical programmer1,
  11. Valeria Proietti, public health officer2,
  12. Chiara Sacco, researcher1,
  13. Marco Massari, researcher1,
  14. Roberto Da Cas, researcher1,
  15. Alberto Mateo-Urdiales, researcher1,
  16. Andrea Siddu, public health officer2,
  17. Serena Battilomo, public health officer2,
  18. Antonino Bella, researcher1,
  19. Anna Teresa Palamara, director of the infectious diseases department1,
  20. Patrizia Popoli, director of the national centre for drug research and evaluation1,
  21. Silvio Brusaferro, president1,
  22. Giovanni Rezza, general director of prevention2,
  23. Francesca Menniti Ippolito, head of the pharmacoepidemiology unit1,
  24. Patrizio Pezzotti, head of the unit of epidemiology, biostatistics, and mathematical modelling1
  25. on behalf of the Italian Integrated Surveillance of covid-19 study group and Italian covid-19 Vaccines Registry group
    1. 1Italian National Institute of Health (ISS), Rome, Italy
    2. 2Italian Ministry of Health, Rome, Italy
    1. Correspondence to: M Fabiani, Infectious Diseases Department, Italian National Institute of Health, Rome, Italy massimo.fabiani{at}iss.it
    • Accepted 19 January 2022

    Abstract

    Objectives To estimate the effectiveness of mRNA vaccines against SARS-CoV-2 infection and severe covid-19 at different time after vaccination.

    Design Retrospective cohort study.

    Setting Italy, 27 December 2020 to 7 November 2021.

    Participants 33 250 344 people aged ≥16 years who received a first dose of BNT162b2 (Pfizer-BioNTech) or mRNA-1273 (Moderna) vaccine and did not have a previous diagnosis of SARS-CoV-2 infection.

    Main outcome measures SARS-CoV-2 infection and severe covid-19 (admission to hospital or death). Data were divided by weekly time intervals after vaccination. Incidence rate ratios at different time intervals were estimated by multilevel negative binomial models with robust variance estimator. Sex, age group, brand of vaccine, priority risk category, and regional weekly incidence in the general population were included as covariates. Geographic region was included as a random effect. Adjusted vaccine effectiveness was calculated as (1−IRR)×100, where IRR=incidence rate ratio, with the time interval 0-14 days after the first dose of vaccine as the reference.

    Results During the epidemic phase when the delta variant was the predominant strain of the SARS-CoV-2 virus, vaccine effectiveness against SARS-CoV-2 infection significantly decreased (P<0.001) from 82% (95% confidence interval 80% to 84%) at 3-4 weeks after the second dose of vaccine to 33% (27% to 39%) at 27-30 weeks after the second dose. In the same time intervals, vaccine effectiveness against severe covid-19 also decreased (P<0.001), although to a lesser extent, from 96% (95% to 97%) to 80% (76% to 83%). High risk people (vaccine effectiveness −6%, −28% to 12%), those aged ≥80 years (11%, −15% to 31%), and those aged 60-79 years (2%, −11% to 14%) did not seem to be protected against infection at 27-30 weeks after the second dose of vaccine.

    Conclusions The results support the vaccination campaigns targeting high risk people, those aged ≥60 years, and healthcare workers to receive a booster dose of vaccine six months after the primary vaccination cycle. The results also suggest that timing the booster dose earlier than six months after the primary vaccination cycle and extending the offer of the booster dose to the wider eligible population might be warranted.

    Introduction

    The covid-19 vaccination campaign in Italy started on 27 December 2020. The campaign targeted healthcare workers, people with an increased risk of severe disease (eg, elderly people or high risk populations), and essential non-healthcare workers (eg, school staff). The campaign was subsequently extended to the general population, with a priority scheme based on age. Up to 24 November 2021, 47 037 541 people (87.1% of the population aged >12 years) had received at least one dose of vaccine, and 45 538 845 (84.3%) had completed the primary vaccination cycle according to the schedule of the brands of the four authorised vaccines in Italy: Comirnaty BNT162b2, Pfizer-BioNTech; Spikevax mRNA-1273, Moderna; Vaxzevria ChAdOx1 nCoV-19, Oxford-AstraZeneca; and Janssen Ad26.COV2-S recombinant, Janssen-Cilag International NV. Eighty three per cent of those who received at least one vaccine dose were vaccinated with an mRNA vaccine: Comirnaty (Pfizer) 70.2%, Spikevax (Moderna) 12.8%.1

    Randomised trials have shown high efficacy of mRNA vaccines against symptomatic covid-19.23 The effectiveness of these vaccines in reducing morbidity and mortality from SARS-CoV-2 infection has been confirmed by observational data in real world scenarios.45678910 Campaigns for the vaccine booster dose targeting high risk groups and elderly people have started in several countries. Based on published studies, clarity is needed on whether the predominant circulation of the delta variant of the SARS-CoV-2 virus has reduced vaccine effectiveness and whether this effect, combined with potential waning of immunity provided by the vaccine, supports the expansion of a booster dose to all population groups and the timing of the booster dose.11121314151617181920 Studies focusing on vaccine effectiveness against any SARS-CoV-2 infection caused by the delta variant showed estimates ranging from 18% (95% confidence interval −13% to 40%) in the general population of Qatar to 85% (61% to 95%) in the general population of Quebec, Canada, approximately six months after completion of the primary vaccination cycle.21 Among the arguments raised against the need for a booster dose is that although vaccine effectiveness against any SARS-CoV-2 infection seems to wane over time since vaccination, effectiveness against severe covid-19 remains high. Based on this argument, to reduce the circulation and lethality of the virus and the possible insurgency of new variants, using the available resources to improve complete primary vaccination coverage, including in lower income countries, has been suggested as a major benefit.22232425

    To our knowledge, no studies conducted in real world scenarios have evaluated vaccine effectiveness more than seven months after completion of the primary vaccination cycle. Our aim, based on a longer follow-up time, was to estimate the effectiveness of mRNA vaccines in preventing SARS-CoV-2 infections (symptomatic or asymptomatic) and severe covid-19 (admission to hospital or death) at different times after vaccination, by epidemic phase, age group, and priority risk category.

    Methods

    Data sources and selection of the study population

    We used deterministic record linkage by individual tax code to combine data from the Italian National Vaccination Registry (held by the Ministry of Health) for people who had been vaccinated, with data on notified people who had tested positive for SARS-CoV-2 infection from the National covid-19 Integrated Surveillance System (coordinated by the Italian National Institute of Health).126 Data were extracted on 24 November 2021 from both sources. We selected all 35 877 432 records of people aged ≥16 years who had received the first dose of an mRNA vaccine before 25 October 2021, thus accounting for at least 14 days of follow-up and 17 days of possible delay in notification of SARS-CoV-2 infection (fig 1 and supplementary fig 1). We did not consider people aged 12-15 years because this age group only had access to vaccination from June 2021, limiting the available follow-up time.

    Fig 1
    Fig 1

    Timeline of periods of selection and events in the study population

    For the analysis of patients with severe covid-19 (that is, SARS-CoV-2 infection followed by admission to hospital or death within 28 days), we considered only people who received a vaccine before 27 September 2021, to allow another four weeks of observation for possible worsening of clinical symptoms (fig 1). Individuals diagnosed as having SARS-CoV-2 infection before receiving their first vaccine dose (n=2 626 441, 7.3%) and those with missing or inconsistent data (n=647, 0.002%) were excluded, and thus 33 250 344 people who had received at least one dose of vaccine were available for the analysis (supplementary fig 1).

    Outcomes and time of infection and exposure

    We studied the incidence of two endpoints: SARS-CoV-2 infection of any severity (symptomatic or asymptomatic) and severe covid-19 (infection with subsequent admission to hospital or death within 28 days). We considered all notified people who had tested positive for SARS-CoV-2 infection in Italy, confirmed in a laboratory by polymerase chain reaction (PCR 97.6%) or, from 15 January 2021, also by antigen test (2.4%). Patients who were reported to have been admitted to hospital or died within four weeks of infection for causes related to covid-19 were classified as severe disease. According to Italian guidelines, based on indications from the World Health Organization,27 a death was considered related to covid-19 if it occurred in the presence of a clinical and instrumental picture suggestive of covid-19, in the absence of a clear cause of death different from covid-19 (eg, road accident), and in the absence of a complete clinical recovery from the disease. Time of infection was the date of onset of symptoms or the date of testing positive, if symptoms or their date of onset were not reported.

    Our data did not include information on possible deaths that occurred for causes unrelated to covid-19. Therefore, based on life tables by region, age, and sex for the year 2020 published by the Italian Institute of Statistics,28 assuming a uniform distribution of deaths over the year, we imputed the expected date of death of people who were vaccinated who did not have a diagnosis of infection to calculate the person days of exposure (see supplementary material for more details). Follow-up ended on the date of SARS-CoV-2 infection for those with an infection of any severity or severe covid-19 before the possible administration of a booster vaccine dose. Conversely, follow-up ended on the date of administration of a booster dose or on the imputed date of death, or was otherwise censored on 7 November 2021 and 10 October 2021 for those who, on those dates, had not received a booster dose and were alive and who did not have a diagnosis of SARS-CoV-2 infection or severe covid-19, respectively.

    Statistical analysis

    Individual time of exposure was divided into weekly time intervals from the first and second doses of vaccine. We then used multilevel negative binomial regression models with robust variance estimator to estimate incidence rate ratios, with 95% confidence intervals, of SARS-CoV-2 infection and severe covid-19 after partial (>14 days after the first dose to ≤14 days after the second dose) and complete (>14 days after the second dose) vaccination compared with the time interval 0-14 days after the first dose (reference exposure, assumed as a proxy for people who were not vaccinated). Time of exposure was measured in days and included as offset in the models.

    The potential confounders included in the models as fixed effects were: sex, age group (16-24 years, five year age groups from 25-29 to 80-84 years, and ≥85 years), brand of vaccine (Comirnaty (Pfizer) and Spikevax (Moderna)), vaccination priority group (none, healthcare workers, residents of long term care facilities, people with comorbidities, immunocompromised people, and essential non-healthcare workers (eg, school staff)), and regional weekly incidence in the general population, derived from the national covid-19 surveillance data. Geographical region of vaccination (defined according to the Eurostat nomenclature of territorial units for statistics, NUTS-2) was included in the models as random effect to account for clustering at the local level.29 The same multivariable model was used to evaluate possible loss of immunity provided by the mRNA vaccine against SARS-CoV-2 infection and severe covid-19 over time after the second dose, with the time interval 0-14 days after the first dose and 3-4 weeks after the second dose of vaccine as the reference values (3-4 weeks being the time interval where the highest level of immune protection provided by mRNA vaccines was seen in our data).

    We grouped the analyses by epidemic phase, distinguishing between the alpha phase, from 27 December 2020 to 13 June 2021, when circulation of the SARS-CoV-2 alpha variant (B.1.1.7) was dominant, and the delta phase, from 19 July 2021 until the censoring dates, when the delta variant (B.1.617.2) was dominant.30 Vaccine effectiveness was calculated as (1−IRR)×100, where IRR=incidence rate ratio. We also conducted analyses grouped by sex, wider age groups (16-39, 40-59, 60-79, and ≥80 years), and by priority risk category, distinguishing between healthcare workers and the overall group of people at increased risk of severe covid-19, referred to here as high risk people (that is, residents of long term care facilities, people with comorbidities, and immunocompromised people).

    Finally, we conducted a sensitivity analysis with the time interval 4-10 days from the first dose of vaccine as the reference exposure to estimate vaccine effectiveness, given that some protection might be evident 10 days after the first vaccination, and that a deferral bias could affect the incidence in the few days immediately after the first dose (eg, people with symptoms are likely to have postponed vaccination).9 The analyses were performed with Stata/MP version 16.1 (StataCorp, Texas, USA).

    Patient and public involvement

    Because the study was a register based retrospective cohort design, we did not involve participants or members of the public in the study design, interpretation of the results, or development of the dissemination strategy.

    Results

    Table 1 shows the characteristics of the 33 250 344 individuals included in the study, all of whom were vaccinated. Most were vaccinated with Comirnaty (Pfizer) (28 319 825, 85.2%). We found that the distribution of sociodemographic characteristics by brand of vaccine did not differ substantially between the two groups.

    Table 1

    Characteristics of individuals included in the study, vaccinated with the Pfizer or Moderna vaccine, Italy, 27 December 2020 to 24 October 2021. Data are number (%) of individuals

    View this table:

    Effectiveness of mRNA vaccines against SARS-CoV-2 infection and severe covid-19 by epidemic phase

    Overall, the effectiveness of complete vaccination (>14 days after the second dose of vaccine) against SARS-CoV-2 infection of any severity decreased from the alpha phase (79%, 95% confidence interval 77% to 81%) to the delta phase (69%, 67% to 71%) (table 2). The decrease was minimal in individuals aged <60 years but was much more marked in those aged ≥60 years, in healthcare workers, and in high risk individuals. Although the overall effectiveness of complete vaccination against severe covid-19 remained substantially stable, even slightly increasing from 89% (88% to 91%) to 91% (90% to 92%), we found a marked reduction in vaccine effectiveness in people aged ≥80 years and in high risk people.

    Table 2

    Effectiveness of mRNA vaccines against SARS-CoV-2 infection and severe covid-19 by epidemic phase, Italy, 27 December 2020 to 7 November 2021

    View this table:

    Reduction of the protective effect of mRNA vaccines over time since vaccination

    Overall, compared with the time interval ≤2 weeks after the first dose of vaccine, we found that during the delta phase, vaccine effectiveness against SARS-CoV-2 infection decreased from 82% (95% confidence interval 80% to 84%) at 3-4 weeks after the second dose of vaccine (that is, the time interval where the highest level of immune protection provided by mRNA vaccines was found in our data) to 33% (27% to 39%) at 27-30 weeks (that is, six months after the second vaccine dose when a booster dose of vaccine is generally recommended). Conversely, vaccine effectiveness remained substantially stable during the alpha phase, slightly increasing from 81% (79% to 83%) at 3-4 weeks after the second dose of vaccine to 90% (86% to 92%) at 19-21 weeks (fig 2). Vaccine effectiveness against severe covid-19 also decreased during the delta phase, although to a lesser extent, from 96% (95% to 97%) at 3-4 weeks after the second dose to 80% (76% to 83%) at 27-30 weeks, whereas vaccine effectiveness slightly increased during the alpha phase, from 88% (86% to 90%) at 3-4 weeks after the second dose to 95% (90% to 97%) at 15-18 weeks (fig 2).

    Fig 2
    Fig 2

    Effectiveness of mRNA vaccines against SARS-CoV-2 infection and severe covid-19 at different time intervals after completion of the primary vaccination cycle, by epidemic phase, Italy, 27 December 2020 to 7 November 2021. Vaccine effectiveness calculated as (1−IRR)×100, where IRR=incidence rate ratio

    The risk of SARS-CoV-2 infection of any severity during the delta phase was 3.7 times higher (95% confidence interval 3.3 to 4.2) at 27-30 weeks than at 3-4 weeks after the second dose of vaccine, whereas the risk of infection was reduced by about 40% at 19-21 weeks after the second dose during the alpha phase (incidence rate ratio 0.56, 0.43 to 0.72) (supplementary fig 2A-B). Compared with 3-4 weeks after the second dose of vaccine, we found that the risk of severe covid-19 during the delta phase was 5.5 times higher (3.9 to 7.9) at 27-30 weeks after the second dose, whereas during the alpha phase, the risk of severe covid-19 was reduced by almost 60% at 15-18 weeks after the second vaccine dose (incidence rate ratio 0.43, 0.24 to 0.80) (supplementary fig 2C-D).

    During the delta phase, loss of protection against SARS-CoV-2 infection after the peak at 3-4 weeks after the second dose of vaccine was more pronounced in high risk people and those aged 60-79 years (supplementary fig 3). At 27-30 weeks after the second dose, vaccine effectiveness was estimated to be similar to no protection in high risk people (−6%, 95% confidence interval −28% to 12%), in people aged ≥80 years (11%, −15% to 31%), and in those aged 60-79 years (2%, −11% to 14%) (fig 3).

    Fig 3
    Fig 3

    Effectiveness of mRNA vaccines against SARS-CoV-2 infection during the delta phase by age group and priority risk category, Italy, 19 July to 7 November 2021. Vaccine effectiveness calculated as (1−IRR)×100, where IRR=incidence rate ratio. *Including people with comorbidities, immunocompromised people, and residents of long term care facilities

    Loss of protection against severe covid-19 after the peak at 3-4 weeks after the second dose of vaccine during the delta phase was more pronounced in high risk people and in those aged 40-59 years (supplementary fig 4), although vaccine effectiveness at 27-30 weeks after the second dose still seemed relatively high in those aged 40-59 years (85%, 95% confidence interval 79% to 89%) (fig 4). In contrast, we found that vaccine effectiveness at 27-30 weeks after the second dose of vaccine was greatly reduced in high risk people (43%, 3% to 67%) compared with other population groups (vaccine effectiveness 64-85%) (fig 4).

    Fig 4
    Fig 4

    Effectiveness of mRNA vaccines against severe covid-19 during the delta phase by age group and priority risk category, Italy, 19 July to 10 October 2021. Vaccine effectiveness calculated as (1−IRR)×100, where IRR=incidence rate ratio. *Including people with comorbidities, immunocompromised people, and residents of long term care facilities

    During the delta phase, vaccine effectiveness against SARS-CoV-2 infection and severe covid-19 more than 30 weeks after the second dose and up to 42 weeks and 38 weeks, respectively, was 21% (95% confidence interval 12% to 29%) and 76% (71% to 81%), showing a progressive decrease from the peak at 3-4 weeks after the second dose in all groups (fig 2, fig 3, and fig 4). The analysis grouped by sex did not show substantial differences between women and men (supplementary fig 5).

    Discussion

    Principal findings

    In Italy, the overall effectiveness of complete vaccination with mRNA vaccines against any SARS-CoV-2 infection decreased from 79% (95% confidence interval 77% to 81%) during the alpha phase to 69% (67% to 71%) during the delta phase, whereas vaccine effectiveness against severe covid-19 remained relatively stable at around 90%. Comparing the two epidemic phases, however, we did not see a substantial reduction in vaccine effectiveness against SARS-CoV-2 infection in the population aged <60 years, although we found a reduction in vaccine effectiveness against severe disease in the high risk population, from 91% (88% to 92%) during the alpha phase to 80% (72% to 85%) during the delta phase, and in people aged ≥80 years, from 90% (88% to 92%) during the alpha phase to 77% (69% to 82%) during the delta phase.

    During the delta phase, we found that at 27-30 weeks after the second dose of vaccine (that is, six months after the second dose when a booster dose of vaccine is generally recommended), vaccine effectiveness against SARS-CoV-2 infection and severe covid-19 was reduced to 33% (27% to 39%) and 80% (76% to 83%), respectively. The decrease in vaccine effectiveness against SARS-CoV-2 infection was more pronounced in high risk people (−6%, −28% to 12%) and in those aged ≥60 years (vaccine effectiveness 2-11%), who no longer seemed to be protected by the vaccine at 27-30 weeks after the second dose. Vaccine effectiveness against severe covid-19 at 27-30 weeks after the second dose was greatly reduced in high risk people (43%, 3% to 67%) compared with the other population groups (vaccine effectiveness 64-85%).

    Comparison with other studies

    Our findings are consistent with other studies. A retrospective cohort study in the US showed reduced overall effectiveness of the Comirnaty (Pfizer) vaccine against infection with the delta variant of the SARS-CoV-2 virus of 75% (95% confidence interval 71% to 78%), waning from 93% at one month after full vaccination to 53% after four months.14 The same study also estimated that the overall effectiveness of the Comirnaty (Pfizer) vaccine against hospital admission after infection with the delta variant was 93% (84% to 96%), close to that seen for other variants (95%, 90% to 98%). A study conducted in Israel showed that immunity against the delta variant of the SARS-CoV-2 virus waned in all age groups a few months after receiving the second dose of vaccine.19 Another study of the mRNA vaccines Comirnaty (Pfizer) and Spikevax (Moderna) estimated vaccine effectiveness at 74% (65% to 85%) against SARS-CoV-2 infection during an epidemic surge of the delta variant in Oregon, US.17 Studies in Scotland and England showed that the effectiveness of complete vaccination with the Comirnaty (Pfizer) vaccine against SARS-CoV-2 infection and severe covid-19 caused by the delta variant was 79% (75% to 82%) and 96% (86% to 99%), respectively.1118

    Strengths and limitations of this study

    From a public health perspective, frequent updates of estimates of vaccine effectiveness and the possible waning effect of vaccines over time are important to guide evidence based decisions on the possibility and timing of booster doses of vaccines, and to identify priority groups. Routinely collected data from surveillance and vaccination registries allows frequent updates, without the need for ad hoc studies involving greater resources and a longer time to conduct to provide useful results, which might be inappropriate in specific contexts. In Italy, for example, where access to work or other types of activities (eg, attending cinemas or indoor restaurants) is available only to people with a green pass, a test negative control design or a cohort study with individuals who were not vaccinated as the control group would probably give biased estimates because the green pass can be obtained after vaccination or after a negative test and is valid for 48 hours. This restriction implies that a high number of swabs are performed every day in Italy, mostly in people who are not vaccinated but who want to go to work or take part in other social activities, thus introducing selection bias in the control group. The design of our study avoided this bias because our study was based on data only from people who were vaccinated, with the time interval 0-14 days after the first dose of vaccine used as the reference to estimate vaccine effectiveness (considered to be the period when there was no protection from the vaccine). This design was used in other studies on vaccine effectiveness in covid-19.103132

    Our study had several limitations. The available data did not allow us to distinguish between the effect of an overall waning of vaccine effectiveness because of a general reduction in immunity from the vaccine over time and the effect of a reduced immune response to infections specifically caused by the delta variant of the SARS-CoV-2 virus. Also, we could not control for individual behavioural factors that could have modified the risk of infection independently. Specifically, a progressive relaxation of legal restrictions favouring physical distancing took place in Italy in the summer of 2021 as the delta variant of the SARS-CoV-2 virus became dominant in the country. This relaxation could have increased the risk of infection in people who were fully vaccinated who might have felt more protected by vaccination compared with those who had received only one dose of vaccine. This increased risk could therefore have led to an underestimation of vaccine effectiveness and overestimation of the protection lost during the delta phase.

    Healthcare workers more exposed to the risk of infection (eg, staff working in the emergency department) were generally vaccinated earlier and tested more frequently, and received a diagnosis of SARS-CoV-2 infection more promptly than other healthcare workers (eg, administrative staff). Consequently, although our results did not show a higher waning of vaccine effectiveness among healthcare workers than other population groups, loss of protection might have been overestimated.

    We used the first two weeks after the first dose of vaccine as a proxy for the period with no protection from the vaccine. The immune response to a vaccine is gradual, however, and people who received their first vaccine dose within this two week period might have had some degree of protection. Also, deferral bias could have affected the incidence of SARS-CoV-2 infection in the days immediately after the first dose of vaccine (that is, people with symptoms are likely to postpone vaccination). Hence by using the first two weeks after the first dose of vaccine as the reference could have underestimated vaccine effectiveness in our study.9 However, results from a sensitivity analysis, with 4-10 days after the first vaccine dose as the reference, although showing slightly higher estimates of vaccine effectiveness, were similar to our main results (table 2), and the same trend in vaccine effectiveness over time was seen (figure 1, figure 2, figure 3, and supplementary material).

    The characteristics of people who were vaccinated changed over time (that is, people at increased risk of infection and severe outcomes received their vaccine earlier than others) and, although we adjusted for priority risk category, we could have overestimated waning of protection from the vaccine, especially at later times after the second dose of vaccine. On the other hand, more susceptible individuals could have been infected earlier and hence excluded from the risk group used to estimate incidence at later time intervals, thus leading to overestimation of vaccine effectiveness and underestimation of its waning over time.

    In some instances, estimates of vaccine effectiveness at the latest time intervals after the second dose of vaccine showed wide 95% confidence intervals (eg, for severe covid-19 in high risk people). Future analyses allowing robust estimates of vaccine effectiveness more than seven months after the primary vaccination cycle would be useful to better evaluate the effect of refusing or delaying a booster dose of vaccine in this vulnerable group.

    Finally, although we accounted for competitive risk of death from causes other than covid-19, specific to region, age, and sex, residual bias is still possible in our estimates because of the differential mortality in some population subgroups. For example, people who are immunocompromised, those with comorbidities, and residents of long term care facilities are probably at higher risk of death from other causes compared with the general population of the same region, age, and sex, thus leading to underestimation of the waning effect in this population subgroup.

    Conclusions

    Our results, based on more than seven months of follow-up after the second dose of an mRNA vaccine, support the ongoing vaccination campaigns targeting high risk groups, people aged ≥60 years, and healthcare workers to receive a booster dose of vaccine six months after the primary vaccination cycle. Our results also suggest that timing the booster dose earlier than six months after the primary vaccination cycle and extending the offer of the booster dose to the wider eligible population might be warranted.

    What is already known on this topic

    • Campaigns for a booster dose of vaccine for covid-19, targeting high risk groups and elderly people, have started in several countries, but extending to the general eligible population and its timing are debated

    • No studies have evaluated vaccine effectiveness more than seven months after the primary vaccination cycle to assess the combined effect of possible waning of immunity provided by the vaccine and dominance of the delta variant of the SARS-CoV-2 virus

    What this study adds

    • The effectiveness of mRNA vaccines against any SARS-CoV-2 infection and severe covid-19 decreased to 33% (95% confidence interval 27% to 39%) and 80% (76% to 83%), respectively, at 27-30 weeks after the second dose of vaccine

    • High risk people (residents in long term care facilities, people with comorbidities, and immunocompromised people) and those aged ≥60 years no longer seemed to have substantial protection against SARS-CoV-2 infection at 27-30 weeks after the primary vaccination, and the initial high vaccine effectiveness against severe covid-19 was greatly reduced in high risk people (43%, 3% to 67%) compared with other population groups (range 64-85%)

    • The findings support recommending a booster dose of vaccine no later than six months after the primary vaccination cycle with mRNA vaccines, giving priority to high risk groups and elderly people

    Ethics statements

    Ethical approval

    Dissemination of covid-19 surveillance data was authorised by the Italian Presidency of the Council of Ministers on 27 February 2020 (ordinance No 640).

    Data availability statement

    Because of data sharing legal restrictions, the dataset, including individual records, cannot be made publicly available. All point estimates with 95% confidence intervals plotted in the figures have been included in the web appendix together with additional data (supplementary materials). Further data will be shared on reasonable request to the corresponding author (MF).

    Acknowledgments

    We thank Gianpaolo Scalia Tomba for his useful suggestions.

    Footnotes

    • Members of the Italian Integrated Surveillance of covid-19 study group and of the covid-19 Vaccines Registry group: Antonino Bella, Alberto Mateo Urdiales, Martina Del Manso, Massimo Fabiani, Matteo Spuri, Chiara Sacco, Stefano Boros, Maria Cristina Rota, Antonietta Filia, Marco Bressi, Maria Fenicia Vescio, Daniele Petrone, Marco Tallon, Corrado Di Benedetto, Alessandra Ciervo, Paola Stefanelli, Serena Battilomo, Valeria Proietti, Flavia Riccardo, Patrizio Pezzotti.

    • Regional representatives of the Italian Integrated Surveillance of covid-19: Antonia Petrucci (Abruzzo); Michele La Bianca (Basilicata); Anna Domenica Mignuoli (Calabria); Pietro Buono (Campania); Erika Massimiliani (Emilia-Romagna); Fabio Barbone (Friuli Venezia Giulia); Francesco Vairo (Lazio); Camilla Sticchi (Liguria); Danilo Cereda (Lombardia); Lucia Di Furia (Marche); Francesco Sforza (Molise); Annamaria Bassot (PA Bolzano); Pier Paolo Benetollo (PA Trento); Chiara Pasqualini (Piemonte); Lucia Bisceglia (Puglia); Maria Antonietta Palmas (Sardegna); Salvatore Scondotto (Sicilia); Emanuela Balocchini (Toscana); Anna Tosti (Umbria); Mauro Ruffier (Valle D'Aosta); Filippo Da Re (Veneto).

    • Regional representatives of the Italian covid-19 Vaccines Registry: Camillo Odio (Abruzzo); Michele Recine (Basilicata); Innocenza Ruberto (Calabria); Salvatore Ascione, Massimo Bisogno (Campania); Gandolfo Miserendino, Massimiliano Navacchia (Emilia-Romagna); Beatrice Del Frate, Emanuela Cau (Friuli Venezia Giulia); Diego Baiocchi, Danilo Fusco (Lazio); Domenico Gallo (Liguria); Maria Rosa Marchetti (Lombardia); Liana Spazzafumo (Marche); Raffaele Malatesta (Molise); Antonio Fanolla (PA Bolzano); Diego Conforti, Carlo Trentini (PA Trento); Antonino Ruggeri (Piemonte); Concetta Ladalardo, Nehludoff Albano (Puglia); Marco Corona, Paolo Lombardi (Sardegna); Massimo Iacono (Sicilia); Paolo Bruno Angori, Andrea Belardinelli (Toscana); Milena Solfiti (Umbria); Stefano Fioraso (Valle D'Aosta); Chiara Poma, Nadia Raccanello (Veneto).

    • Contributors: MF, MP, CM, SSA, AF, FDA, FR, AM-U, FMI, and PPe designed the study. MS, MDM, MT, CS, MM, RDC, SBa, and AB retrieved and prepared the data. MF, MP, MS, SSA, CS, VP, MM, and PPe carried out the analysis. MF, MP, CM, SSA, AF, FDA, FR, AM-U, AS, ATP, PPo, SBr, GR, FMI, and PPe wrote the manuscript. All authors critically revised and approved the final version of the manuscript. FMI and PPe are the guarantors. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

    • Funding: This study did not receive external funding.

    • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/disclosure-of-interest/ and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

    • FMI and PPe affirm that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned have been explained.

    • Dissemination to participants and related patient and public communities: The results of the study might be published in a press release and on social media channels.

    • Provenance and peer review: Not commissioned; externally peer reviewed.

    http://creativecommons.org/licenses/by-nc/4.0/

    This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

    References