Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Short-term forecasts to inform the response to the Covid-19 epidemic in the UK

View ORCID ProfileS Funk, View ORCID ProfileS Abbott, BD Atkins, M Baguelin, View ORCID ProfileJK Baillie, P Birrell, J Blake, View ORCID ProfileNI Bosse, View ORCID ProfileJ Burton, J Carruthers, View ORCID ProfileNG Davies, D De Angelis, L Dyson, WJ Edmunds, View ORCID ProfileRM Eggo, NM Ferguson, K Gaythorpe, View ORCID ProfileE Gorsich, View ORCID ProfileG Guyver-Fletcher, J Hellewell, View ORCID ProfileEM Hill, View ORCID ProfileA Holmes, TA House, C Jewell, View ORCID ProfileM Jit, T Jombart, I Joshi, View ORCID ProfileMJ Keeling, E Kendall, ES Knock, AJ Kucharski, KA Lythgoe, View ORCID ProfileSR Meakin, View ORCID ProfileJD Munday, View ORCID ProfilePJM Openshaw, CE Overton, View ORCID ProfileF Pagani, J Pearson, PN Perez-Guzman, L Pellis, F Scarabel, View ORCID ProfileMG Semple, K Sherratt, M Tang, MJ Tildesley, View ORCID ProfileE Van Leeuwen, View ORCID ProfileLK Whittles, CMMID COVID-19 Working Group, Imperial College COVID-19 Response Team, ISARIC4C Investigators
doi: https://doi.org/10.1101/2020.11.11.20220962
S Funk
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S Funk
  • For correspondence: sebastian.funk@lshtm.ac.uk
S Abbott
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S Abbott
BD Atkins
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M Baguelin
3MRC Centre for Global Infectious Disease Analysis, Jameel Institute for Disease and Emergency Analytics, Imperial College London, London, W2 1PG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
JK Baillie
4Roslin Institute, University of Edinburgh, Edinburgh, EH25 9RG, UK
5Intensive Care Unit, Royal Infirmary Edinburgh, Edinburgh, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for JK Baillie
P Birrell
6MRC Biostatistics Unit, University of Cambridge, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR, UK
7National Infection Service, Public Health England, 61 Colindale Avenue, London, NW9 5EQ, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J Blake
6MRC Biostatistics Unit, University of Cambridge, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
NI Bosse
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for NI Bosse
J Burton
8Division of Informatics, Imaging and Data Sciences, Faculty of Biology Medicine and Health,The University of Manchester, Oxford Road, Manchester, M13 9PT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J Burton
J Carruthers
7National Infection Service, Public Health England, 61 Colindale Avenue, London, NW9 5EQ, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
NG Davies
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for NG Davies
D De Angelis
6MRC Biostatistics Unit, University of Cambridge, Forvie Site, Robinson Way, Cambridge Biomedical Campus, Cambridge, CB2 0SR, UK
7National Infection Service, Public Health England, 61 Colindale Avenue, London, NW9 5EQ, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
L Dyson
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
WJ Edmunds
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
RM Eggo
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for RM Eggo
NM Ferguson
3MRC Centre for Global Infectious Disease Analysis, Jameel Institute for Disease and Emergency Analytics, Imperial College London, London, W2 1PG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
K Gaythorpe
3MRC Centre for Global Infectious Disease Analysis, Jameel Institute for Disease and Emergency Analytics, Imperial College London, London, W2 1PG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
E Gorsich
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for E Gorsich
G Guyver-Fletcher
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for G Guyver-Fletcher
J Hellewell
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
EM Hill
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for EM Hill
A Holmes
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A Holmes
TA House
9Department of Mathematics, University of Manchester, Oxford Road, Manchester M13 9PL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
C Jewell
10Centre for Health Informatics, Computing and Statistics, Lancaster Medical School, Lancaster University, Lancaster LA1 4YG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M Jit
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M Jit
T Jombart
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
I Joshi
11NHSX, Skipton House, 80 London Road, London, SE1 6LH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
MJ Keeling
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for MJ Keeling
E Kendall
12NHS England & NHSE Improvement, Quarry House, Quarry Hill, Leeds LS2 7UE, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
ES Knock
3MRC Centre for Global Infectious Disease Analysis, Jameel Institute for Disease and Emergency Analytics, Imperial College London, London, W2 1PG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
AJ Kucharski
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
KA Lythgoe
13Big Data Institute, University of Oxford, Old Road Campus, Oxford, OX3 7LF
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
SR Meakin
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for SR Meakin
JD Munday
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for JD Munday
PJM Openshaw
14National Heart and Lung Institute, Imperial College London, London, SW3 6LY, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for PJM Openshaw
CE Overton
9Department of Mathematics, University of Manchester, Oxford Road, Manchester M13 9PL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
F Pagani
9Department of Mathematics, University of Manchester, Oxford Road, Manchester M13 9PL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for F Pagani
J Pearson
11NHSX, Skipton House, 80 London Road, London, SE1 6LH, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
PN Perez-Guzman
3MRC Centre for Global Infectious Disease Analysis, Jameel Institute for Disease and Emergency Analytics, Imperial College London, London, W2 1PG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
L Pellis
9Department of Mathematics, University of Manchester, Oxford Road, Manchester M13 9PL, UK
15The Alan Turing Institute, British Library, 96 Euston Road, London, NW1 2DB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
F Scarabel
16Laboratory for Industrial and Applied Mathematics, York University, Toronto, ON, M3J 1P3, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
MG Semple
17NIHR Health Protection Research Unit in Emerging and Zoonotic Infections an Institute of Infection, Veterinary and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, L69 7TX, UK
18Respiratory Medicine, Alder Hey Children’s Hospital, Liverpool L12 2AP, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for MG Semple
K Sherratt
1Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene & Tropical Medicine, Keppel St, London, WC1E 7HT, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M Tang
12NHS England & NHSE Improvement, Quarry House, Quarry Hill, Leeds LS2 7UE, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
MJ Tildesley
2The Zeeman Institute for Systems Biology & Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, CV4 7AL, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
E Van Leeuwen
7National Infection Service, Public Health England, 61 Colindale Avenue, London, NW9 5EQ, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for E Van Leeuwen
LK Whittles
3MRC Centre for Global Infectious Disease Analysis, Jameel Institute for Disease and Emergency Analytics, Imperial College London, London, W2 1PG, UK
7National Infection Service, Public Health England, 61 Colindale Avenue, London, NW9 5EQ, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for LK Whittles
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Short-term forecasts of infectious disease can aid situational awareness and planning for outbreak response. Here, we report on multi-model forecasts of Covid-19 in the UK that were generated at regular intervals starting at the end of March 2020, in order to monitor expected healthcare utilisation and population impacts in real time.

Methods We evaluated the performance of individual model forecasts generated between 24 March and 14 July 2020, using a variety of metrics including the weighted interval score as well as metrics that assess the calibration, sharpness, bias and absolute error of forecasts separately. We further combined the predictions from individual models into ensemble forecasts using a simple mean as well as a quantile regression average that aimed to maximise performance. We compared model performance to a null model of no change.

Results In most cases, individual models performed better than the null model, and ensembles models were well calibrated and performed comparatively to the best individual models. The quantile regression average did not noticeably outperform the mean ensemble.

Conclusions Ensembles of multi-model forecasts can inform the policy response to the Covid-19 pandemic by assessing future resource needs and expected population impact of morbidity and mortality.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

The following funding sources are acknowledged as providing funding for the named authors: Wellcome Trust (210758/Z/18/Z, 206250/Z/17/Z); Health Data Research UK (grant: MR/S003975/1), the Medical Research Council (MC_PC 19065, MR/V009761/1); the National Institute for Health Research (NIHR) Health Protection Research Unite (HPRU) in Modelling and Health Economics, a partnership between PHE, Imperial College London and the London School of Hygiene & Tropical Medicine (grant code NIHR200908); the HPRU in the Health Protection Research Unit in Genomics and Enabling Data; the NIHR (16/137/109) using UK aid from the UK Government to support global health research; the European Union's Horizon 2020 research and innovation programme - project EpiPose (No 101003688); the Bill & Melinda Gates Foundation (INV-003174). This research was partly funded by the Global Challenges Research Fund (GCRF) project 'RECAP' managed through RCUK and ESRC (ES/P010873/1); the Wellcome Trust and the Royal Society (202562/Z/16/Z, 107652/Z/15/Z); the Department of Mathematics at the University of Manchester for PhD funding; the Canadian Institute of Health Research (CIHR) 2019 Novel Coronavirus (COVID-19) rapid research program. The views expressed are those of the authors and not necessarily those of the United Kingdom (UK) Department of Health and Social Care, the National Health Service, the National Institute for Health Research (NIHR), or Public Health England (PHE). The following funding sources are acknowledged as providing funding for the CMMID COVID-19 Working Group authors: Alan Turing Institute; BBSRC LIDP: BB/M009513/1; B&MGF: INV-003174, INV-001754, OPP1157270, OPP1180644, OPP1183986, NTD Modelling Consortium OPP1184344, OPP1191821; DHSC/UK Aid/NIHR: ITCRZ 03010; Elrha R2HC/UK DFID/Wellcome Trust/NIHR, DFID/Wellcome Trust: Epidemic Preparedness Coronavirus research programme 221303/Z/20/Z; ERC Starting Grant: #757699; European Commission: 101003688; Global Challenges Research Fund: ES/P010873/1; MRC: MR/N013638/1, MC_PC_19065, MR/P014658/1; Nakajima Foundation; NIHR: 16/136/46, 16/137/109, NIHR200929, PR-OD-1017-20002; Royal Society: Dorothy Hodgkin Fellowship, RP\EA\180004; Wellcome Trust: 206250/Z/17/Z, 206471/Z/17/Z, 208812/Z/17/Z, 210758/Z/18/Z; UK MRC: LID DTP MR/N013638/1.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

London School of Hygiene & Tropical Medicine Ethics Committee (Ref. 22828).

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Figure 1 and 3 clarified with what data was available at the time. Reference to the quantgen R package added.

Data Availability

All publicly available data used in the manuscript is available at https://github.com/epiforecasts/covid19.forecasts.uk Some of the data used for forecasts, and to generate the results in this manuscript, were shared with modellers in confidence and cannot be made available by the authors.

https://github.com/epiforecasts/covid19.forecasts.uk

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted December 04, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Short-term forecasts to inform the response to the Covid-19 epidemic in the UK
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Short-term forecasts to inform the response to the Covid-19 epidemic in the UK
S Funk, S Abbott, BD Atkins, M Baguelin, JK Baillie, P Birrell, J Blake, NI Bosse, J Burton, J Carruthers, NG Davies, D De Angelis, L Dyson, WJ Edmunds, RM Eggo, NM Ferguson, K Gaythorpe, E Gorsich, G Guyver-Fletcher, J Hellewell, EM Hill, A Holmes, TA House, C Jewell, M Jit, T Jombart, I Joshi, MJ Keeling, E Kendall, ES Knock, AJ Kucharski, KA Lythgoe, SR Meakin, JD Munday, PJM Openshaw, CE Overton, F Pagani, J Pearson, PN Perez-Guzman, L Pellis, F Scarabel, MG Semple, K Sherratt, M Tang, MJ Tildesley, E Van Leeuwen, LK Whittles, CMMID COVID-19 Working Group, Imperial College COVID-19 Response Team, ISARIC4C Investigators
medRxiv 2020.11.11.20220962; doi: https://doi.org/10.1101/2020.11.11.20220962
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Short-term forecasts to inform the response to the Covid-19 epidemic in the UK
S Funk, S Abbott, BD Atkins, M Baguelin, JK Baillie, P Birrell, J Blake, NI Bosse, J Burton, J Carruthers, NG Davies, D De Angelis, L Dyson, WJ Edmunds, RM Eggo, NM Ferguson, K Gaythorpe, E Gorsich, G Guyver-Fletcher, J Hellewell, EM Hill, A Holmes, TA House, C Jewell, M Jit, T Jombart, I Joshi, MJ Keeling, E Kendall, ES Knock, AJ Kucharski, KA Lythgoe, SR Meakin, JD Munday, PJM Openshaw, CE Overton, F Pagani, J Pearson, PN Perez-Guzman, L Pellis, F Scarabel, MG Semple, K Sherratt, M Tang, MJ Tildesley, E Van Leeuwen, LK Whittles, CMMID COVID-19 Working Group, Imperial College COVID-19 Response Team, ISARIC4C Investigators
medRxiv 2020.11.11.20220962; doi: https://doi.org/10.1101/2020.11.11.20220962

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (269)
  • Allergy and Immunology (549)
  • Anesthesia (134)
  • Cardiovascular Medicine (1747)
  • Dentistry and Oral Medicine (238)
  • Dermatology (172)
  • Emergency Medicine (310)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (653)
  • Epidemiology (10780)
  • Forensic Medicine (8)
  • Gastroenterology (584)
  • Genetic and Genomic Medicine (2933)
  • Geriatric Medicine (286)
  • Health Economics (531)
  • Health Informatics (1918)
  • Health Policy (833)
  • Health Systems and Quality Improvement (743)
  • Hematology (290)
  • HIV/AIDS (627)
  • Infectious Diseases (except HIV/AIDS) (12496)
  • Intensive Care and Critical Care Medicine (684)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (321)
  • Neurology (2780)
  • Nursing (150)
  • Nutrition (431)
  • Obstetrics and Gynecology (554)
  • Occupational and Environmental Health (597)
  • Oncology (1454)
  • Ophthalmology (440)
  • Orthopedics (172)
  • Otolaryngology (255)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (379)
  • Pediatrics (865)
  • Pharmacology and Therapeutics (362)
  • Primary Care Research (333)
  • Psychiatry and Clinical Psychology (2630)
  • Public and Global Health (5338)
  • Radiology and Imaging (1002)
  • Rehabilitation Medicine and Physical Therapy (594)
  • Respiratory Medicine (722)
  • Rheumatology (329)
  • Sexual and Reproductive Health (288)
  • Sports Medicine (278)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (149)
  • Urology (125)