Efficacy Estimates for Various COVID-19 Vaccines: What we Know from the Literature and Reports

Julia Shapiro, Natalie E. Dean, Zachary J. Madewell, Yang Yang, M.Elizabeth Halloran, Ira Longini
doi: https://doi.org/10.1101/2021.05.20.21257461

Abstract

In this report, we provide summary estimates, from publications and reports, of vaccine efficacy (VE) for the COVID-19 vaccines that are being rolled out on a global scale. We find that, on average, the efficacy against any disease with infection is 85% (95% CI: 71 - 93%) after a fully course of vaccination. The VE against severe disease, hospitalization or death averages close to 100%. The average VE against infection, regardless of symptoms, is 84% (95% CI: 70 - 91%). We also find that the average VE against transmission to others for infected vaccinated people is 48% (95% CI: 45 - 52%). Finally, we prove summary estimates of the VE against any disease with infection for some of the variants of concern (VOC). The average VE for the VOC γ (P1) is 61% (95% CI: 43 - 73%). The average VE for the VOC α (B.1.1.7), β (B.1.351), and δ (B.1.617.2) after dose 1 are 48% (95% CI: 44 - 51%), 35% (95% CI: -11 - 62%), and 33% (95% CI: 21 - 43%), respectively. The average VE for the VOC α (B.1.1.7), β (B.1.351), and δ (B.1.617.2) after dose 2 are 85% (95% CI: 25 - 97%), 57% (95% CI: 14 - 78%), and 78% (95% CI: 28 - 93%), respectively.

Introduction

In this report, we summarize estimates of vaccine efficacy (VE) for the COVID-19 vaccines that are being rolled out on local and global scales. This includes the Pfizer, Moderna, Johnson & Johnson, AstraZeneca, Sputnik, Novavax, Sinovac, and Sinopharm vaccines. VE estimates are taken from journal articles and media reports for the vaccines that have gone through double-blinded, placebo-controlled, phase III vaccine trials, as well as observational studies. Some of the estimates are based on rigorous, preplanned statistical analyses from double-blinded, placebo-controlled trials, while others are extracted from observational studies with different levels of control. These studies are reported from a variety of sources including publications, reports, and sometimes press releases. Because of this, we do not carry out a formal meta analysis. In all cases, we try to extract estimates for one or more of the triplet of vaccine efficacy parameters (V ES, V EP, V EI) [1], where V ES is VE against infection; V EP is VE against disease, given infection; and V EI is VE against transmission to others, given infection. A fourth parameter, V ESP, which is VE against disease and infection, tends to be available from vaccine trials, and it is the usual primary outcome for those trials (i.e., cases of disease that are confirmed infections). The V ESP is a function of both the V ES and V EP. If we believe in a multiplicative and independent relationship, then V ESP = 1–(1—V ES)(1 −V EP). Thus, if we have two of these VE’s, we can always calculate the third.

In the material that follows, we give estimates of these VE’s as a function of time when protection is believed to begin to occur after the first and second dose for two-dose vaccines, and after the first dose for one-dose vaccines. We also provide V ESP estimates for protection against the variants of concern (VOC) γ (P1), α (B.1.1.7), β (B.1.351), and δ (B.1.617.2). The methods for creating the forest plots are given in the Appendix. The supporting tables for the analysis are also given in the Appendix. Not all estimates described in the tables are given in the figures, as we have tried to extract the essential information without getting lost in too much detail. However, virtually all the complete information is given in the Appendix tables.

Results

We first consider VE for the original wild type viruses. Figure 1 (Table A1) give the estimates of the V ESP after the second dose for two-dose vaccines. All the estimates are from double-blinded, placebo-controlled vaccine trials. With the exception of the Sinovac vaccine, they are all over 80%, with a summary estimate of 85% (95% CI: 71 - 93%). The Sinovac V ESP estimate is 51% (95% CI: 36 - 62%).

Figure 1:
Figure 1: Forest plot of vaccine efficacy to prevent any disease after dose 2, V ESP.

* indicates double-blinded, randomized vaccine trial.

The estimated V ESP after one dose, for both two-dose and one-dose vaccines, is given in Figure 2 (Table A2), where the Johnson & Johnson vaccine is the only one-dose vaccine listed. The estimates are generally almost as high as protection after one dose, with summary estimated of 82% (95% CI: 72 - 88%).

Figure 2:
Figure 2: Forest plot of vaccine efficacy to prevent any disease after dose 1, V ESP.

* indicates double-blinded, randomized vaccine trial.

Figure 3 (Table A3) give the estimates of the Embedded Image (VE for severe disease with infection) after the second dose for two-dose vaccines. The estimates a very high, and generally close to 100%, with relatively poor precision.

Figure 3:
Figure 3: Forest plot of vaccine efficacy to prevent severe disease after dose 2, Embedded Image.

* indicates double-blinded, randomized vaccine trial.

Figure 4 (Table A4) give the estimates of the Embedded Image (VE for severe disease with infection) after the first dose for two-dose vaccines and one dose for the one-dose vaccine. The summary estimated is quite high at 86% (95% CI: 39 - 97%).

Figure 4:
Figure 4: Forest plot of vaccine efficacy to prevent severe disease after dose 1, Embedded Image.

* indicates double-blinded, randomized vaccine trial.

VE against hospitalization and death were quite high, as shown in Figures 5 and 6 (Tables A5 and A6).

Figure 5:
Figure 5: Forest plot of vaccine efficacy to prevent hospitalization, Embedded Image.

* indicates double-blinded, randomized vaccine trial.

Figure 6:
Figure 6: Forest plot of vaccine efficacy to prevent death, Embedded Image.

* indicates double-blinded, randomized vaccine trial.

Figure 7 (Table A7) give the estimates of the V ES, i.e., VE against infection. The estimates were quite high, with a summary estimate of 84% (95% CI: 70 - 91%).

Figure 7:
Figure 7: Forest plot of vaccine efficacy to prevent infection, V ES.

* indicates double-blinded, randomized vaccine trial.

Figure 8:
Figure 8:

Forest plot of vaccine efficacy to prevent infectiousness to others, V EI

(Table A8) give estimates of the V EI, i.e., VE against infectiousness or direct transmission to others. The summary measure is 48% (95% CI: 45 - 52%), indicating the vaccination reduces the transmission to others by 48% when vaccinated people are infected, compared to unvaccinated people who become infected.

Now we consider VE’s for the variants of concern (VOC). Estimates are available for the V ESP, mostly after the first dose for the one dose vaccine and the second dose for the two dose vaccines. These estimates are given in Figures 9-15 (Tables A9-A15).

Figure 9:
Figure 9: Forest plot of vaccine efficacy against α (B.1.1.7) after dose 1
Figure 10:
Figure 10: Forest plot of vaccine efficacy against α (B.1.1.7) after dose 2
Figure 11:
Figure 11: Forest plot of vaccine efficacy against (γ) (P.1)
Figure 12:
Figure 12: Forest plot of vaccine efficacy against β (B.1.351) after dose 1
Figure 13:
Figure 13: Forest plot of vaccine efficacy against β (B.1.351) after dose 2
Figure 14:
Figure 14: Forest plot of vaccine efficacy against δ (B.1.617.2) after dose 1
Figure 15:
Figure 15: Forest plot of vaccine efficacy against δ (B.1.617.2) after dose 2

For α (B.1.1.7), VE is 48% (95% CI: 44 - 51%) after dose 1, and VE is 85% (95% CI: 25 - 97%) after dose 2. The summary estimate for VE after dose 1 is considerably lower than the VE for the wild type virus. In contrast, however, the summary estimate after dose 2 is just somewhat reduced compared to the wild type virus. It is necessary to note that this VOC does not have a mutation that affects immunity, whereas the other VOC’s have mutations that affect immune function.

The average VE for the VOC γ (P1) is 61% (95% CI: 43 - 73%). For β (B.1.351), VE is 35% (95% CI: -11 - 62%) after dose 1, and VE is 57% (95% CI: 14 - 78%) after dose 2. The summary estimates for VE after dose 1 and dose 2 are considerably lower than the VE’s for the wild type virus.

For δ (B.1.617.2), VE is 33% (95% CI: 21 - 43%) after dose 1, and VE is 78% (95% CI: 28 - 93%) after dose 2. The summary estimate for VE after dose 1 is considerably lower than the VE for the wild type virus. In contrast, however, the summary estimate after dose 2 is just somewhat reduced compared to the wild type virus.

Discussion

We have presented the relevant VE estimates for the COVID-19 vaccines that are being rolled out on a global scale and for which there is sufficient quality data. We provide estimates of VE against disease with confirmed infection, infection, and transmission to others. The VE estimates against disease are stratified by disease severity, hospitalization and death. We have also provided VE estimates for three of the VOC.

These estimates should be useful for constructing mathematical models for vaccination impact and for making policy decisions involving vaccination. We plan to keep updating this report as more information becomes available.

Methods

For each vaccine efficacy measure (e.g., severe disease, infection), we first obtained log odds ratios and corresponding sampling variances from each vaccine efficacy estimate and 95% confidence interval (CI). We then fit random-effects models to these data to estimate average log odds ratios, which we back-transformed to obtain VE summary estimates and 95% CIs. All analyses were done in R version 4.0.2 using the package metafor (R Project for Statistical Computing) [2, 3].

Data Availability

We agree to make data used to compile this paper available

Funding

This work was partially funded by NIH grants R01AI139761 and R56AI148284.

Appendix

Here we give the details about the studies and data that are summarized in the figures. Note: * indicates that the VE estimate is based on double-blinded, randomized trials.

View this table:
Table 1: Vaccine efficacy to prevent any disease after dose 2, V ESP
View this table:
Table 2: Vaccine efficacy to prevent any disease after dose 1, V ESP
View this table:
Table 3: Vaccine efficacy to prevent severe disease after dose 2, Embedded Image
View this table:
Table 4: Vaccine efficacy to prevent severe disease after dose 1, Embedded Image
View this table:
Table 5: Vaccine efficacy to prevent hospitalization, Embedded Image
View this table:
Table 6: Vaccine efficacy to prevent death, Embedded Image
View this table:
Table 7: Vaccine efficacy to prevent infection, V ES
View this table:
Table 8: Vaccine efficacy to prevent infectiousness to others, V EI
View this table:
Table 9: Vaccine efficacy against α (B.1.1.7) after dose 1
View this table:
Table 10: Vaccine efficacy against α (B.1.1.7) after dose 2
View this table:
Table 11: Vaccine efficacy against γ (P.1)
View this table:
Table 12: Vaccine efficacy against β (B.1.351) after dose 1
View this table:
Table 13: Vaccine efficacy against β (B.1.351) after dose 2
View this table:
Table 14: Vaccine efficacy against δ (B.1.617.2) after dose 1
View this table:
Table 15: Vaccine efficacy against δ (B.1.617.2) after dose 2
View this table:
Table 16: Viral neutralization of the variants of concern as compared with pre-existing variants

References

  1. [1].↵
    Halloran ME, Longini IM, Struchiner CJ. Design and Analysis of Vaccine Studies. Springer; 2010.
  2. [2].↵
    Viechtbauer W. Conducting Meta-Analyses in R with the metafor Package. Journal of Statistical Software, Articles. 2010;36(3):1–48. Available from: https://www.jstatsoft.org/v036/i03.
    OpenUrl
  3. [3].↵
    R Core Team. R: a language and environment for statistical computing;. Available from: https://www.gbif.org/tool/81287/r-a-language-and-environment-for-statistical-computing.
  4. [4].
    ModernaTX; 2020. Available from: https://www.fda.gov/media/144434/download.
  5. [5].
    Pfizer; 2020. Available from: https://www.fda.gov/media/144246/download.
  6. [6].
    Emary KR, Golubchik T, Aley PK, Ariani CV, Angus BJ, Bibi S, et al. Efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine against SARS-CoV-2 VOC 202012/01 (B. 1.1. 7). The Lancet. 2021.
  7. [7].
  8. [8].
    Supply Vaccines to Eliminate Human Diseases;. Available from: http://www.sinovacbio.com/news/shownews.php?id=1154&lang=en.
  9. [9].
    Evidence Assessment: Sinopharm/bbibp Covid-19 Vaccine. Sage Working Group;. Available from: https://cdn.who.int/media/docs/default-source/immunization/sage/2021/april/2_sage29apr2021_critical-evidence_sinopharm.pdf.
  10. [10].
    Dagan N, Barda N, Kepten E, Miron O, Perchik S, Katz MA, et al. BNT162b2 mRNA Covid-19 vaccine in a nationwide mass vaccination setting. New England Journal of Medicine. 2021.
  11. [11].
    Janssen Biotech, Inc; 2021. Available from: https://www.fda.gov/media/146217/download.
  12. [12].
    Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Safety and Efficacy of Single-Dose Ad26. COV2. S Vaccine against Covid-19. New England Journal of Medicine. 2021.
  13. [13].
    Novavax Confirms High Levels of Efficacy Against Original and Variant COVID-19 Strains in United Kingdom and South Africa Trials;. Available from: https://ir.novavax.com/news-releases/news-release-details/novavax-confirms-high-levels-efficacy-against-original-and.
  14. [14].
    Jones I, Roy P. Sputnik V COVID-19 vaccine candidate appears safe and effective. The Lancet. 2021;397(10275):642–643.
    OpenUrl
  15. [15].
    COVID-19 Vaccine AstraZeneca confirms 100% protection against severe disease, hospitalisation and death in the primary analysis of Phase III trials; 2021. Available from: https://www.astrazeneca.com/media-centre/press-releases/2021/covid-19-vaccine-astrazeneca-confirms-protection-against-severe-disease-hospitalisation-and-death-in-the-primary-analysis-of-phase-iii-trials.html.
  16. [16].
    Logunov DY, Dolzhikova IV, Shcheblyakov DV, Tukhvatulin AI, Zubkova OV, Dzharul-laeva AS, et al. Safety and efficacy of an rAd26 and rAd5 vector-based heterologous prime-boost COVID-19 vaccine: an interim analysis of a randomised controlled phase 3 trial in Russia. The Lancet. 2021;397(10275):671–681.
    OpenUrl
  17. [17].
    GRADE: Moderna COVID-19 Vaccine. Centers for Disease Control and Prevention; 2020. Available from: https://www.cdc.gov/vaccines/acip/recs/grade/covid-19-moderna-vaccine.html.
  18. [18].
    Vasileiou E, Simpson CR, Shi T, Kerr S, Agrawal U, Akbari A, et al. Interim findings from first-dose mass COVID-19 vaccination roll-out and COVID-19 hospital admissions in Scotland: a national prospective cohort study. The Lancet. 2021.
  19. [19].
    Interim Estimates of Vaccine Effectiveness of BNT162b2 and mRNA-1273 COVID-19 Vaccines in Preventing SARS-CoV-2 Infection Among Health Care Personnel, First Responders, and Other Essential and Frontline Workers - Eight U.S. Locations, December 2020–March 2021. Centers for Disease Control and Prevention; 2021. Available from: https://www.cdc.gov/mmwr/volumes/70/wr/mm7013e3.htm.
  20. [20].
    Hall VJ, Foulkes S, Saei A, Andrews N, Oguti B, Charlett A, et al. COVID-19 vaccine coverage in health-care workers in England and effectiveness of BNT162b2 mRNA vaccine against infection (SIREN): a prospective, multicentre, cohort study. The Lancet. 2021.
  21. [21].
    K; Cgltstad. Assessment of Effectiveness of 1 Dose of BNT162b2 Vaccine for SARS-CoV-2 Infection 13 to 24 Days After Immunization. U.S. National Library of Medicine;. Available from: https://pubmed.ncbi.nlm.nih.gov/34097044/.
  22. [22].
    Harris RJ, Hall JA, Zaidi A, Andrews NJ, Dunbar JK, Dabrera G. Impact of vaccination on household transmission of SARS-COV-2 in England. medRxiv. 2021.
  23. [23].
    Abdool Karim SS, de Oliveira T. New SARS-CoV-2 Variants - Clinical, Public Health, and Vaccine Implications. New England Journal of Medicine. Available from: https://doi.org/10.1056/NEJMc2100362.
  24. [24].
    Abu-Raddad LJ, Chemaitelly H, Butt AA. Effectiveness of the BNT162b2 Covid-19 Vaccine against the B.1.1.7 and B.1.351 Variants. New England Journal of Medicine. Available from: https://doi.org/10.1056/NEJMc2104974.
  25. [25].
    Bernal JL, Andrews N, Gower C, Gallagher E, Simmons R, Thelwall S, et al. Effectiveness of COVID-19 vaccines against the B.1.617.2 variant. medRxiv. 2021. Available from: https://www.medrxiv.org/content/early/2021/05/24/2021.05.22.21257658.
  26. [26].
  27. [27].
    Collier DA, De Marco A, Ferreira IA, Meng B, Datir R, Walls AC, et al. Sensitivity of SARS-CoV-2 B. 1.1. 7 to mRNA vaccine-elicited antibodies. Nature. 2021:1–8.
  28. [28].
    Wu K, Werner AP, Koch M, Choi A, Narayanan E, Stewart-Jones GB, et al. Serum Neutralizing Activity Elicited by mRNA-1273 Vaccine. New England Journal of Medicine. 2021.
  29. [29].
    Hitchings M, Ranzani OT, Torres MS, de Oliveira SB, Almiron M, Said R, et al. Effectiveness of CoronaVac in the setting of high SARS-CoV-2 P. 1 variant transmission in Brazil: A test-negative case-control study. medRxiv. 2021.
  30. [30].
    Madhi SA, Baillie V, Cutland CL, Voysey M, Koen AL, Fairlie L, et al. Efficacy of the ChAdOx1 nCoV-19 Covid-19 Vaccine against the B. 1.351 Variant. New England Journal of Medicine. 2021.
  31. [31].
    Shinde V, Bhikha S, Hoosain Z, Archary M, Bhorat Q, Fairlie L, et al. Efficacy of NVX-CoV2373 Covid-19 Vaccine against the B.1.351 Variant. New England Journal of Medicine. Available from: https://doi.org/10.1056/NEJMoa2103055.
  32. [32].
    Science Brief: Background Rationale and Evidence for Public Health Recommendations for Fully Vaccinated People. Centers for Disease Control and Prevention;. Available from: https://www.cdc.gov/coronavirus/2019-ncov/science/science-briefs/fully-vaccinated-people.html#ref4.
Back to top
Posted June 18, 2021.
Download PDF
Data/Code
Email
Efficacy Estimates for Various COVID-19 Vaccines: What we Know from the Literature and Reports
Julia Shapiro, Natalie E. Dean, Zachary J. Madewell, Yang Yang, M.Elizabeth Halloran, Ira Longini
medRxiv 2021.05.20.21257461; doi: https://doi.org/10.1101/2021.05.20.21257461
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area