Abstract
Background Identifying and testing individuals likely to have SARS-CoV-2 is critical for infection control, including post-vaccination. Vaccination is a major public health strategy to reduce SARS-CoV-2 infection globally. Some individuals experience systemic symptoms post-vaccination, which overlap with COVID-19 symptoms. This study compared early post-vaccination symptoms in individuals who subsequently tested positive or negative for SARS-CoV-2, using data from the COVID Symptom Study (CSS) app.
Design We conducted a prospective observational study in UK CSS participants who were asymptomatic when vaccinated with Pfizer-BioNTech mRNA vaccine (BNT162b2) or Oxford-AstraZeneca adenovirus-vectored vaccine (ChAdOx1 nCoV-19) between 8 December 2020 and 17 May 2021, who subsequently reported symptoms within seven days (other than local symptoms at injection site) and were tested for SARS-CoV-2, aiming to differentiate vaccination side-effects per se from superimposed SARS-CoV-2 infection. The post-vaccination symptoms and SARS-CoV-2 test results were contemporaneously logged by participants. Demographic and clinical information (including comorbidities) were also recorded. Symptom profiles in individuals testing positive were compared with a 1:1 matched population testing negative, including using machine learning and multiple models including UK testing criteria.
Findings Differentiating post-vaccination side-effects alone from early COVID-19 was challenging, with a sensitivity in identification of individuals testing positive of 0.6 at best. A majority of these individuals did not have fever, persistent cough, or anosmia/dysosmia, requisite symptoms for accessing UK testing; and many only had systemic symptoms commonly seen post-vaccination in individuals negative for SARS-CoV-2 (headache, myalgia, and fatigue).
Interpretation Post-vaccination side-effects per se cannot be differentiated from COVID-19 with clinical robustness, either using symptom profiles or machine-derived models. Individuals presenting with systemic symptoms post-vaccination should be tested for SARS-CoV-2, to prevent community spread.
Funding Zoe Limited, UK Government Department of Health and Social Care, Wellcome Trust, UK Engineering and Physical Sciences Research Council, UK National Institute for Health Research, UK Medical Research Council and British Heart Foundation, Alzheimer’s Society, Chronic Disease Research Foundation, Massachusetts Consortium on Pathogen Readiness (MassCPR).
Evidence before this study There are now multiple surveillance platforms internationally interrogating COVID-19 and/or post-vaccination side-effects. We designed a study to examine for differences between vaccination side-effects and early symptoms of COVID-19. We searched PubMed for peer-reviewed articles published between 1 January 2020 and 21 June 2021, using keywords: “COVID-19” AND “Vaccination” AND (“mobile application” OR “web tool” OR “digital survey” OR “early detection” OR “Self-reported symptoms” OR “side-effects”). Of 185 results, 25 studies attempted to differentiate symptoms of COVID-19 vs. post-vaccination side-effects; however, none used artificial intelligence (AI) technologies (“machine learning”) coupled with real-time data collection that also included comprehensive and systematic symptom assessment. Additionally, none of these studies attempt to discriminate the early signs of infection from side-effects of vaccination (specifically here: Pfizer-BioNTech mRNA vaccine (BNT162b2) and Oxford-AstraZeneca adenovirus-vectored vaccine (ChAdOx1 nCoV-19)). Further, none of these studies sought to provide comparisons with current testing criteria used by healthcare services.
Added value of this study This study, in a uniquely large community-based cohort, uses prospective data capture in a novel effort to identify individuals with COVID-19 in the immediate post-vaccination period. Our results show that early symptoms of SARS-CoV-2 cannot be differentiated from vaccination side-effects robustly. Thus, post-vaccination systemic symptoms should not be ignored, and testing should be considered to prevent COVID-19 dissemination by vaccinated individuals.
Implications of all the available evidence Our study demonstrates the critical importance of testing symptomatic individuals - even if vaccinated – to ensure early detection of SARS-CoV-2 infection, helping to prevent future pandemic waves in the UK and elsewhere.
Competing Interest Statement
ELD and CJS report grants from the Chronic Disease Research Foundation (CDRF) during the conduct of the study. CH, SS, LP, AM report other from ZOE Limited, during the conduct of the study. TS is a scientific advisor to ZOE Limited. CHS reports grants from Alzheimer's Society, during the conduct of the study. SO reports grants from the Wellcome Trust, Innovate UK (UKRI), and Chronic Disease Research Foundation (CDRF), during the conduct of the study.
Funding Statement
ZOE Limited provided in-kind support for all aspects of building, running and supporting the app and service to all users worldwide. This work is supported by the Wellcome EPSRC Centre for Medical Engineering at King's College London (WT 203148/Z/16/Z) and the UK Department of Health via the National Institute for Health Research (NIHR) comprehensive Biomedical Research Centre award to Guy's & St Thomas' NHS Foundation Trust in partnership with King's College London and King's College Hospital NHS Foundation Trust. Investigators also received support from Medical Research Council (MRC), British Heart Foundation (BHF), Alzheimer's Society, European Union, NIHR, COVID-19 Driver Relief Fund (CDRF) and the NIHR-funded BioResource, Clinical Research Facility and Biomedical Research Centre (BRC) based at GSTT NHS Foundation Trust in partnership with KCL. EM is funded by an MRC Skills Development Fellowship Scheme at KCL. SO was supported by the French government, through the 3IA Cote d'Azur Investments in the Future project managed by the National Research Agency (ANR) with the reference number ANR-19-P3IA-0002. This research was funded in part by the Wellcome Trust [215010/Z/18/Z]. For the purpose of Open Access, the author has applied a CC BY public copyright licence to any Author Accepted Manuscript (AAM) version arising from this submission.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The app and CSS were approved in the UK by KCL's ethics committee (REMAS no. 18210, review reference LRS 19/20 18210). All app users provided informed consent for use of their data for COVID-19 research.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
Data collected in the COVID Symptom Study smartphone application are shared with other health researchers through the UK National Health Service-funded Health Data Research UK (HDRUK) and Secure Anonymised Information Linkage consortium, housed in the UK Secure Research Platform (Swansea, UK). Anonymised data are available to be shared with researchers according to their protocols in the public interest (https://web.www.healthdatagateway.org/dataset/fddcb382-3051-4394-8436-b92295f14259). The code is available in: https://gitlab.com/KCL-BMEIS/covid-zoe/vaccination.
https://web.www.healthdatagateway.org/dataset/fddcb382-3051-4394-8436-b92295f1425
Abbreviations
- AUC
- Area under the curve
- bMEM
- Bayesian mixed-effect model
- BMI
- Body mass index
- CI
- confidence interval
- COVID-19
- Coronavirus disease 2019
- CSS
- COVID Symptom Study
- IQR
- inter-quartile range
- KCL
- King’s College London
- LFAT
- Lateral flow antigen test
- LR
- Logistic regression
- MD
- Missing data
- NHS UK
- National Health Service of the United Kingdom
- O-AZ
- Oxford-AstraZeneca adenovirus-vectored vaccine
- PB
- Pfizer-BioNTech mRNA vaccine
- RF
- Random forest
- ROC
- Receiver operating curve
- rtPCR
- Reverse transcription polymerase chain reaction
- SARS-CoV-2
- severe acute respiratory syndrome-related coronavirus 2
- UK
- United Kingdom of Great Britain and Northern Ireland
