TY - JOUR T1 - Potential Test-Negative Case-Control Study Bias in Outbreak Settings: Application to Ebola vaccination in Democratic Republic of Congo JF - medRxiv DO - 10.1101/2020.01.06.20016576 SP - 2020.01.06.20016576 AU - Carl A. B. Pearson AU - W. John Edmunds AU - Thomas J. Hladish AU - Rosalind M. Eggo Y1 - 2020/01/01 UR - http://medrxiv.org/content/early/2020/01/10/2020.01.06.20016576.abstract N2 - Background Infectious disease outbreaks present unique challenges to study designs for vaccine evaluation. Test-negative case-control (TNCC) studies have been used to estimate vaccine efficacy previously, and have been proposed for Ebola virus disease (EVD) vaccines. However, there are key differences in how cases and controls are recruited during outbreaks that have implications for the reliability of vaccine efficacy estimates from these studies.Methods We use a modelling approach to quantify TNCC bias for a prophylactic vaccine distributed across varying study and epidemiological scenarios. Our model accounts for vaccine distribution heterogeneity and for the two potential routes of recruitment: self-reporting and contact-tracing. We derive the TNCC estimator for this model and suggest ways to translate outbreak response data into the parameters of the model.Results We found systematic biases in vaccine estimates from a TNCC study in our model of outbreak conditions. Biases are introduced due to differential recruitment from self-report and contact-tracing, and by clustering of participation in vaccination. We estimate the magnitude of these biases, and highlight options to manage them via restricted recruitment. For the motivating example of EVD, the absolute bias should be less 10%.Conclusions A TNCC study may generate biased estimates of vaccine efficacy during outbreaks. Bias can be limited via recruitment that either minimizes heterogeneity in vaccination in the recruited population or excludes recruitment of contact-traced individuals. TNCC studies for outbreak infections should record the reason for testing to quantify potential bias in the vaccine efficacy estimate. Perfectly distinguishing the recruitment route may be difficult in practice, so it will be challenging to entirely remove this bias.Key Messages- Test-Negative Case-Control (TNCC) studies can be biased when follow-up of cases leads to recruitment, which may happen during outbreak response.- The absolute bias can be quantified using epidemiological measures.- Bias can be limited by ensuring homogeneous vaccine coverage amongst potential recruits.- Bias can be eliminated if excluding recruits from contact-tracing is practical.- Based on assumptions about the outbreak in Nord Kivu DRC starting in 2018, a TNCC vaccine study there would have a maximum absolute bias of less than 10% due to these effects.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work was supported by the Innovative Medicines Initiative 2 (IMI2) Joint Undertaking between European Union Horizon 2020 Research and Innovation Programme and the European Federation of Pharmaceutical Industries and Associations [EBOVAC3: grant number 800176]; Department of Health and Social Care using UK Aid funding managed by the NIHR [VEEPED: PR-OD-1017-20007]; National Institutes of Health, National Institute of General Medical Sciences [U54 GM111274]; and HDR UK Innovation Fellowship [grant MR/S003975/1 to R.M.E.]. The views expressed in this publication are those of the authors and not necessarily those of the Department of Health and Social Care.Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe results are simulation-based. All code for those simulations can be found in the repository. https://gitlab.com/ebovac/tncc_math ER -