PT  - JOURNAL ARTICLE
AU  - McAndrew, Thomas
AU  - Cambeiro, Juan
AU  - Besiroglu, Tamay
TI  - Aggregating probabilistic predictions of the safety, efficacy, and timing of a COVID-19 vaccine
AID  - 10.1101/2021.06.03.21258240
DP  - 2021 Jan 01
TA  - medRxiv
PG  - 2021.06.03.21258240
4099  - http://medrxiv.org/content/early/2021/06/04/2021.06.03.21258240.short
4100  - http://medrxiv.org/content/early/2021/06/04/2021.06.03.21258240.full
AB  - Safe, efficacious vaccines were developed to reduce the transmission of SARS-CoV-2 during the COVID-19 pandemic. But in the middle of 2020, vaccine effectiveness, safety, and the timeline for when a vaccine would be approved and distributed to the public was uncertain. To support public health decision making, we solicited trained forecasters and experts in vaccinology and infectious disease to provide monthly probabilistic predictions from July to September of 2020 of the efficacy, safety, timing, and delivery of a COVID-19 vaccine. We found, that despite sparse historical data, a consensus—a combination of human judgment probabilistic predictions—can quantify the uncertainty in clinical significance and timing of a potential vaccine. The consensus underestimated how fast a therapy would show a survival benefit and the high efficacy of approved COVID-19 vaccines. However, the consensus did make an accurate prediction for when a vaccine would be approved by the FDA. Compared to individual forecasters, the consensus was consistently above the 50th percentile of the most accurate forecasts. A consensus is a fast and versatile method to build probabilistic predictions of a developing vaccine that is robust to poor individual predictions. Though experts and trained forecasters did underestimate the speed of development and the high efficacy of a SARS-CoV-2 vaccine, consensus predictions can improve situational awareness for public health officials and for the public make clearer the risks, rewards, and timing of a vaccine.Competing Interest StatementThe authors have declared no competing interest.Funding StatementNAAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Lehigh University's Office of Research Integrity deemed this work "Not Human Subjects Research" All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAs much data and code as possible is available at https://github.com/computationalUncertaintyLab/vaccinceAndTherapeuticsCrowd https://github.com/computationalUncertaintyLab/vaccinceAndTherapeuticsCrowd