PT  - JOURNAL ARTICLE
AU  - Henderson, Alec S.
AU  - Hickson, Roslyn I.
AU  - Furlong, Morgan
AU  - McBryde, Emma S.
AU  - Meehan, Michael T.
TI  - Reproducibility of COVID-era infectious disease models
AID  - 10.1101/2023.10.11.23296911
DP  - 2023 Jan 01
TA  - medRxiv
PG  - 2023.10.11.23296911
4099  - http://medrxiv.org/content/early/2023/10/12/2023.10.11.23296911.short
4100  - http://medrxiv.org/content/early/2023/10/12/2023.10.11.23296911.full
AB  - Infectious disease modelling has been prominent throughout the COVID-19 pandemic, helping to understand the virus’ transmission dynamics and inform response policies. Given their potential importance and translational impact, we evaluated the computational reproducibility of infectious disease modelling articles from the COVID era. We found that only four out of 100 randomly sampled studies released between January 2020 and August 2022 could be computationally reproduced using the resources provided (e.g., code, data, instructions). For the 100 most highly cited articles from the same period we found that only 11 were reproducible. Reflecting on our experience, we discuss common issues affecting computational reproducibility and how these might be addressed.Competing Interest StatementThe authors acknowledge that a number of their own articles were eligible for inclusion in the current study. Although none were selected (through either randomisation or citation count), very few are likely to have been computationally reproducibleFunding StatementM.M. is supported by an Australian Research Council Discovery Early Career Researcher Award, DE210101344.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAnonymised data and code for reproducing the claims and table of the paper can be found at: https://github.com/AITHM/Reproducing-the-Infectious-Disease-Models-of-the-Covid-Era