RT Journal Article SR Electronic T1 Short-term forecasts to inform the response to the Covid-19 epidemic in the UK JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2020.11.11.20220962 DO 10.1101/2020.11.11.20220962 A1 S Funk A1 S Abbott A1 BD Atkins A1 M Baguelin A1 JK Baillie A1 P Birrell A1 J Blake A1 NI Bosse A1 J Burton A1 J Carruthers A1 NG Davies A1 D De Angelis A1 L Dyson A1 WJ Edmunds A1 RM Eggo A1 NM Ferguson A1 K Gaythorpe A1 E Gorsich A1 G Guyver-Fletcher A1 J Hellewell A1 EM Hill A1 A Holmes A1 TA House A1 C Jewell A1 M Jit A1 T Jombart A1 I Joshi A1 MJ Keeling A1 E Kendall A1 ES Knock A1 AJ Kucharski A1 KA Lythgoe A1 SR Meakin A1 JD Munday A1 PJM Openshaw A1 CE Overton A1 F Pagani A1 J Pearson A1 PN Perez-Guzman A1 L Pellis A1 F Scarabel A1 MG Semple A1 K Sherratt A1 M Tang A1 MJ Tildesley A1 E Van Leeuwen A1 LK Whittles A1 CMMID COVID-19 Working Group A1 Imperial College COVID-19 Response Team A1 ISARIC4C Investigators YR 2020 UL http://medrxiv.org/content/early/2020/12/04/2020.11.11.20220962.abstract AB Background Short-term forecasts of infectious disease can aid situational awareness and planning for outbreak response. Here, we report on multi-model forecasts of Covid-19 in the UK that were generated at regular intervals starting at the end of March 2020, in order to monitor expected healthcare utilisation and population impacts in real time.Methods We evaluated the performance of individual model forecasts generated between 24 March and 14 July 2020, using a variety of metrics including the weighted interval score as well as metrics that assess the calibration, sharpness, bias and absolute error of forecasts separately. We further combined the predictions from individual models into ensemble forecasts using a simple mean as well as a quantile regression average that aimed to maximise performance. We compared model performance to a null model of no change.Results In most cases, individual models performed better than the null model, and ensembles models were well calibrated and performed comparatively to the best individual models. The quantile regression average did not noticeably outperform the mean ensemble.Conclusions Ensembles of multi-model forecasts can inform the policy response to the Covid-19 pandemic by assessing future resource needs and expected population impact of morbidity and mortality.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe following funding sources are acknowledged as providing funding for the named authors: Wellcome Trust (210758/Z/18/Z, 206250/Z/17/Z); Health Data Research UK (grant: MR/S003975/1), the Medical Research Council (MC_PC 19065, MR/V009761/1); the National Institute for Health Research (NIHR) Health Protection Research Unite (HPRU) in Modelling and Health Economics, a partnership between PHE, Imperial College London and the London School of Hygiene & Tropical Medicine (grant code NIHR200908); the HPRU in the Health Protection Research Unit in Genomics and Enabling Data; the NIHR (16/137/109) using UK aid from the UK Government to support global health research; the European Union's Horizon 2020 research and innovation programme - project EpiPose (No 101003688); the Bill & Melinda Gates Foundation (INV-003174). This research was partly funded by the Global Challenges Research Fund (GCRF) project 'RECAP' managed through RCUK and ESRC (ES/P010873/1); the Wellcome Trust and the Royal Society (202562/Z/16/Z, 107652/Z/15/Z); the Department of Mathematics at the University of Manchester for PhD funding; the Canadian Institute of Health Research (CIHR) 2019 Novel Coronavirus (COVID-19) rapid research program. The views expressed are those of the authors and not necessarily those of the United Kingdom (UK) Department of Health and Social Care, the National Health Service, the National Institute for Health Research (NIHR), or Public Health England (PHE). The following funding sources are acknowledged as providing funding for the CMMID COVID-19 Working Group authors: Alan Turing Institute; BBSRC LIDP: BB/M009513/1; B&MGF: INV-003174, INV-001754, OPP1157270, OPP1180644, OPP1183986, NTD Modelling Consortium OPP1184344, OPP1191821; DHSC/UK Aid/NIHR: ITCRZ 03010; Elrha R2HC/UK DFID/Wellcome Trust/NIHR, DFID/Wellcome Trust: Epidemic Preparedness Coronavirus research programme 221303/Z/20/Z; ERC Starting Grant: #757699; European Commission: 101003688; Global Challenges Research Fund: ES/P010873/1; MRC: MR/N013638/1, MC_PC_19065, MR/P014658/1; Nakajima Foundation; NIHR: 16/136/46, 16/137/109, NIHR200929, PR-OD-1017-20002; Royal Society: Dorothy Hodgkin Fellowship, RP\EA\180004; Wellcome Trust: 206250/Z/17/Z, 206471/Z/17/Z, 208812/Z/17/Z, 210758/Z/18/Z; UK MRC: LID DTP MR/N013638/1. Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:London School of Hygiene & Tropical Medicine Ethics Committee (Ref. 22828).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll publicly available data used in the manuscript is available at https://github.com/epiforecasts/covid19.forecasts.uk Some of the data used for forecasts, and to generate the results in this manuscript, were shared with modellers in confidence and cannot be made available by the authors. https://github.com/epiforecasts/covid19.forecasts.uk