OpenSAFELY: Effectiveness of COVID-19 vaccination in children and adolescents

Background Children and adolescents in England were offered BNT162b2 as part of the national COVID-19 vaccine roll out from September 2021. We assessed the safety and effectiveness of first and second dose BNT162b2 COVID-19 vaccination in children and adolescents in England. Methods With the approval of NHS England, we conducted an observational study in the OpenSAFELY-TPP database, including a) adolescents aged 12-15 years, and b) children aged 5-11 years and comparing individuals receiving i) first vaccination with unvaccinated controls and ii) second vaccination to single-vaccinated controls. We matched vaccinated individuals with controls on age, sex, region, and other important characteristics. Outcomes were positive SARS-CoV-2 test (adolescents only); COVID-19 A&E attendance; COVID-19 hospitalisation; COVID-19 critical care admission; COVID-19 death, with non-COVID-19 death and fractures as negative control outcomes and A&E attendance, unplanned hospitalisation, pericarditis, and myocarditis as safety outcomes. Results Amongst 820,926 previously unvaccinated adolescents, the incidence rate ratio (IRR) for positive SARS-CoV-2 test comparing vaccination with no vaccination was 0.74 (95% CI 0.72-0.75), although the 20-week risks were similar. The IRRs were 0.60 (0.37-0.97) for COVID-19 A&E attendance, 0.58 (0.38-0.89) for COVID-19 hospitalisation, 0.99 (0.93-1.06) for fractures, 0.89 (0.87-0.91) for A&E attendances and 0.88 (0.81-0.95) for unplanned hospitalisation. Amongst 441,858 adolescents who had received first vaccination IRRs comparing second dose with first dose only were 0.67 (0.65-0.69) for positive SARS-CoV-2 test, 1.00 (0.20-4.96) for COVID-19 A&E attendance, 0.60 (0.26-1.37) for COVID-19


Background
The UK's COVID-19 vaccination programme was extended to adolescents aged 12-15 years on 20 September 2021, with an adult 30 µg dose of Pfizer-BioNTech (BNT162b2) vaccine licensed for use (1).Children aged 5-11 years were eligible from 4 April 2022, using a 10µg dose (2).Individuals considered high-risk, for example those with immunosuppressive conditions or living with a vulnerable adult, were eligible earlier (adolescents in August 2021 (3) and children in January 2022 (4)).
Authorisation in children and adolescents was based on phase II/III randomized trials (RCTs) showing high immunogenicity and efficacy against infection.However, protection against severe disease and safety endpoints were not assessed in RCTs (5).Multiple countries have reported rare cases of myocarditis and pericarditis following mRNA COVID-19 vaccines(6-8): these events are listed in BNT162b2 product information (9).We used the OpenSAFELY-TPP database, covering 40% of English primary care practices and linked to national coronavirus surveillance, hospital episodes, and death registry data, to emulate a hypothetical target trial to evaluate the effectiveness of childhood COVID-19 vaccination against COVID-19 related and other outcomes.

Data source
All data were linked, stored and analysed securely using the OpenSAFELY platform, https://www.opensafely.org/,as part of the NHS England OpenSAFELY COVID-19 service.Data include pseudonymised data such as coded diagnoses, medications and physiological parameters.No free text data was included.All code is shared openly for review and re-use under MIT open license [https://github.com/opensafely/vaccine-effectiveness-in-kids].Detailed pseudonymised patient data is potentially re-identifiable and therefore not shared.Primary care records managed by the GP software provider, TPP were linked to ONS death data and the Index of Multiple Deprivation through OpenSAFELY.

Eligibility criteria, vaccination groups, and matching
We included a) all adolescents aged 12-15 years and b) all children aged 5-11 years on 31 August 2021, when age-based vaccine eligibility criteria were defined, who were not clinically vulnerable, as defined by the Joint Committee on Vaccination and Immunisation (JCVI) (clinically vulnerable individuals were eligible for vaccination prior to the start of the study entry period); had been continuously registered at a GP practice using TPP's SystmOne clinical information system for 42 days; had no evidence of SARS-CoV-2 infection or COVID-19 disease within the 30 days before vaccination; and had complete information on sex, deprivation, ethnicity, and NHS region.
We estimated the effectiveness and safety of: i) first vaccine dose vs. no vaccination, and ii) a second dose vs. a single dose only by emulating a sequence of target trials.For the first vaccine dose, on each day of the study period, each eligible individual vaccinated with their first dose was matched 1:1 without replacement with an eligible individual who had not yet been vaccinated.Unvaccinated individuals were matched to at most one vaccinated individual, but were eligible for inclusion in the vaccination group later on if they were subsequently vaccinated.Follow-up of the vaccinated group included time after second vaccination.We used the same approach to assess effectiveness and safety of a second vaccine dose, amongst individuals who had received a first vaccine dose.

Follow-up
Each individual was followed from assignment to a comparison group ('time zero') until the earliest of: end of freely-available community testing (positive SARS-CoV-2 test only); outcome; death; practice de-registration; 20 weeks; vaccination of the unvaccinated control (first dose group only) or second vaccination of the control (second dose group only).

Statistical Analysis
We estimated period-specific incidence rates in each treatment group (number of events divided by person-time at risk) and derived incidence rate ratios and 95% CIs.We also derived 20-week risk differences (RD), and corresponding 95% CIs from the sum of squares of Greenwood standard errors.We estimated effectiveness separately according to whether there was evidence of prior SARS-CoV-2 infection (Supplementary Tables 1-4).

Software, code, and reproducibility
Data management and analyses were conducted in Python version 3.8.10 and R version 4.0.5.Code for data management and analysis, as well as codelists, are archived online https://github.com/opensafely/vaccine-effectiveness-in-kids.

Disclosure control
Any reported figures based on counts below 8 were redacted.Cumulative incidence plots are not reported for outcomes with fewer than 30 outcomes.To reduce re-identification risk, counts are reported to the nearest n * 6−3 (3,9,15,21,…).All derived statistics are based on these rounded counts, including cumulative incidence curves which are based on rounded numbers-at-risk and event counts.

Adolescents
Of 513,192 eligible adolescents who were registered at a TPP practice and received a BNT162b2 vaccination during the study period, 410,463 (80%) were matched with unvaccinated controls.(Supplementary Figure 1, panel A).220,929 (81%) of 271,440 eligible adolescents who received a second BNT162b2 vaccination were matched with single vaccinated controls (Supplementary Figure 1, panel B).
As expected, the matching factors, other than age, were identically distributed in the vaccinated and control groups at the start of follow-up for all of the study populations (Table 1).Over 60% of adolescents in the first vaccination group received a second vaccination.Most second vaccinations occurred at least 12 weeks after first vaccination (Supplementary Figure 2).
The incidence of positive SARS-CoV-2 test after first vaccine dose in adolescents declined substantially between 10 days and 6 weeks after vaccination, then increased (Figure 1).By 15 weeks the cumulative incidence of positive SARS-CoV-2 tests was similar in the first dose and unvaccinated groups.The 20-week risks per 10,000 were 1,961 (95% CI 1,932-1,990) and 1,979 (1,950-2,008) in the vaccinated and unvaccinated groups respectively.The IRR comparing vaccinated with unvaccinated adolescents was 0.74 (95% CI 0.72-0.75)(Table 2).

Effectiveness of second dose vs single dose only in adolescents
In 30,444 person-years follow-up after first vaccination in adolescents, there were 14,910 positive SARS-CoV-2 tests; 6 COVID-19 A&E attendances; 24 COVID-19 hospitalisations, none of which included admission to critical care; and no COVID-19 deaths.There were no non-COVID-19 related deaths; 1,158 fractures; 7,488 A&E attendances; 876 unplanned hospitalisations; 3 cases of pericarditis and no cases of myocarditis.All pericarditis events occurred in the single dose group.Further analyses were restricted to positive SARS-CoV-2 tests, A&E attendance, fractures and unplanned hospitalisation.
The incidence of positive SARS-CoV-2 test after second dose declined between 10 days and 6 weeks after vaccination, then increased (Figure 1).By 14 weeks the cumulative incidence of positive SARS-CoV-2 test was similar in the second and single dose groups.The 20-week risks per 10,000 were 850 (95% CI 802-899) and 898 (861-935) after second and single dose respectively.The IRR comparing second with single doses was 0.67 (95% CI 0.65-0.69)(Table 2).

Myocarditis and pericarditis in adolescents
Less than 51% of adolescents diagnosed with pericarditis were admitted to hospital, and less than 51% attended emergency care.More than 51% of adolescents with myocarditis were admitted to hospital and more than 51% attended emergency care.The maximum length of critical care admission was 1 day for either event.The maximum length of hospitalisation stay was 0 days for pericarditis and 2 days for myocarditis.There were no deaths after these events.

Children
Of 177,360 children eligible in the first vaccination group 141,711 (80%) were matched with unvaccinated controls.(Supplementary Figure 2, panel A).66,231 (67%) of 99,102 children who received a second BNT162b2 vaccination were matched with single vaccinated control.(Supplementary Figure 2, panel 2).Nearly 60% of children in the first vaccination group received a second vaccination.Most second vaccinations occurred at least 12 weeks after the first vaccination (Supplementary Figure 2).

Effectiveness of first dose vs unvaccinated in children
In 32,476 person-years follow-up, there were no COVID-19 A&E attendances; 6 COVID-19 hospitalisations (none included admission to critical care) and no COVID-19 or non-COVID-19 related deaths.There were 1,254 fractures; 8,016 A&E attendances; 798 unplanned hospitalisations; 3 cases of pericarditis and no cases of myocarditis.All pericarditis events occurred in the first dose group.Further analyses were restricted to fractures, A&E attendance and unplanned hospitalisation.

Effectiveness of second dose vs single dose only in children
In 8,875 person-years follow-up, there were no COVID-19 A&E attendances; no COVID-19 hospitalisations; no admissions to critical care; and no COVID-19 or non-COVID-19 related deaths.There were 264 fractures; 1,680 A&E attendances; 144 unplanned hospitalisations; and no cases of pericarditis or myocarditis.Further analyses were restricted to fractures, A&E attendance and unplanned hospitalisation.

Myocarditis and pericarditis events in children
No children experienced a myocarditis event, all 3 pericarditis events occurred after first vaccination and did not require hospitalisation or critical care.

Discussion
This observational cohort study of COVID-19 vaccination with BNT162b2 in England based on 410,463 adolescents (12-15 years old) receiving a first vaccination, 220,029 adolescents receiving a second vaccination, 141,711 children (5-11 years old) receiving a first vaccination and 66,231 children receiving a second vaccination, found that an initial protective effect against positive SARS-CoV-2 test in adolescents waned by 14 weeks.The incidence of COVID-19 A&E attendance was lower after first vaccination than in the unvaccinated group for adolescents and COVID-19 A&E attendance was rare in the other adolescent group and the child groups.COVID-19-related hospitalisation, and critical care attendance were rare in both adolescents and children and there were no COVID-19 related deaths.Whilst rare, all myocarditis and pericarditis events during the study period occurred in vaccinated individuals: there were no deaths after myocarditis or pericarditis.The rate of fractures was similar across vaccine groups in both adolescents and children.None of the child cohort required hospitalisation or critical care after a pericarditis event.In the adolescents the maximum length of hospital admission was 1 day for critical care and 2 days for hospitalisation.
Our findings provide insights into the balance between protection by vaccination against target outcomes (positive SARS-CoV-2 tests, COVID-19 related hospitalisation and emergency care) and the increased risk of pericarditis and myocarditis.In adolescents the reduction in risk of COVID-19 hospitalisation per 10,000 individuals (-1.14 for first dose versus unvaccinated, -1.45 for second versus first dose) was larger than the increase in risk of both myocarditis (0.08 for first dose versus unvaccinated) and pericarditis (0.31 for first dose versus unvaccinated, 0.21 for second versus first dose).However, the reduction in risk of COVID-19 hospitalisation in children (-0.02 for first dose versus unvaccinated) was lower than the increase in risk of pericarditis (0.22).

Strengths and Limitations
Our study has several limitations.First, bias due to unmeasured confounding is possible, although the detailed data available in OpenSAFELY allowed us to match vaccinated with control individuals on multiple characteristics.For example, it was not possible to reliably identify individuals with COVID-19 symptoms prior to testing or hospital admission, because this information is not routinely recorded in primary care records.Delayed vaccination in individuals with symptoms may explain the apparent effectiveness against positive tests during the first week, however, the incidence of positive tests substantially reduced from 1-2 weeks in the vaccinated group (Figure 1A) compared with the unvaccinated group, consistent with a delayed but protective immunological response to vaccination.A similar pattern was observed for second dose versus single dose vaccination (Figure 1B).Lifestyle factors that may influence both health and vaccination are not fully recorded in health records.The slightly higher rate of fractures (negative control outcome) in single-vaccinated adolescents and children compared to the second dose group could indicate limited unmeasured confounding.Second, positive SARS-CoV-2 test data underestimates the true incidence of infection.Both lateral flow tests and PCR tests were freely available in the UK until 31 March 2023, but many asymptomatic and some symptomatic infections will not have been recorded.Differences in testing behaviour between vaccinated and unvaccinated people may have contributed to the apparent waning effect if testing is more common among vaccinated individuals.Third, myocarditis and pericarditis following COVID-19 vaccination were publicly reported from May 2021 (12).The vaccinations in our study were after this date, so there is a potential for ascertainment bias if diagnostic thresholds were lower in vaccinated than unvaccinated individuals.Fourth, we excluded clinically vulnerable children and adolescents who were eligible for vaccination before the general roll out, so our results may not be generalisable to this group.Vaccine safety and effectiveness in this group are important, but there are significant challenges in controlling confounding arising from unmeasured severity of underlying conditions that could influence vaccine uptake and effectiveness.Fifth, due to small numbers we did not study vaccine effectiveness in those who had received a vaccination other than BNT162b2.

Findings in context
BNT162b2 vaccination was shown to be effective in protecting against COVID-19 infection in a multinational phase 3 trial of 2,260 adolescents aged 12-15 with a median follow up of 2 months (13,14).Multiple observational studies have found that effectiveness wanes with time since vaccination (15,16).A recent systematic review found generally limited evidence regarding clinical outcomes of BNT162b2 vaccination amongst children and adolescents (17), although vaccination lowered hospitalisation rates including emergency admission.
Several studies have reported that children infected with SARS-CoV-2 appear to have the same degree of severity of illness as seen in adults (18)(19)(20).Most reported post-vaccination cases of myocarditis and pericarditis in children and adolescents were mild (21).A systematic review found that myocarditis and pericarditis in children and adolescents were more prevalent among males and after the second dose of BNT162b2 (22).Whilst all cases of myocarditis and pericarditis in our study occurred in the vaccinated groups, we did not find higher rates of myocarditis or pericarditis after the second compared to the first dose.The rates of heart inflammation (myocarditis and pericarditis) in under 18s reported by the UK Medicines and Healthcare products Regulatory Agency were 13 and 8 per million after first and second doses respectively, compared with our estimates of 27 and 10 per million respectively.

Conclusion
This study found that initial protection by BNT162b2 vaccination against positive SARS-CoV-2 tests in adolescents aged 12-15 had waned by 14 weeks after vaccination.Rates of COVID-19 hospitalisation and COVID-19 A&E attendance were lower after first and second dose BNT162b2 vaccination in adolescents.Positive SARS-CoV-2 testing could not be considered for children.Severe outcomes were rare in children: there were fewer than seven (exact number redacted) COVID-19 hospitalisations and no COVID-19 A&E attendances, critical care admissions or COVID-19 deaths.

Administrative
are supported by BG's grants on this work.The views expressed are those of the authors and not necessarily those of the NIHR, NHS England, UK Health Security Agency (UKHSA) or the Department of Health and Social Care.
Funders had no role in the study design, collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication.

Information governance and ethical approval
NHS England is the data controller of the NHS England OpenSAFELY COVID-19 Service; TPP is the data processor; all study authors using OpenSAFELY have the approval of NHS England (22).This implementation of OpenSAFELY is hosted within the TPP environment which is accredited to the ISO 27001 information security standard and is NHS IG Toolkit compliant (23).
Patient data has been pseudonymised for analysis and linkage using industry standard cryptographic hashing techniques; all pseudonymised datasets transmitted for linkage onto OpenSAFELY are encrypted; access to the NHS England OpenSAFELY COVID-19 service is via a virtual private network (VPN) connection; the researchers hold contracts with NHS England and only access the platform to initiate database queries and statistical models; all database activity is logged; only aggregate statistical outputs leave the platform environment following best practice for anonymisation of results such as statistical disclosure control for low cell counts (24).
The service adheres to the obligations of the UK General Data Protection Regulation (UK GDPR) and the Data Protection Act 2018.The service previously operated under notices initially issued in February 2020 by the the Secretary of State under Regulation 3(4) of the Health Service (Control of Patient Information) Regulations 2002 (COPI Regulations), which required organisations to process confidential patient information for COVID-19 purposes; this set aside the requirement for patient consent (25).As of 1 July 2023, the Secretary of State has requested that NHS England continue to operate the Service under the COVID-19 Directions 2020 (26).In some cases of data sharing, the common law duty of confidence is met using, for example, patient consent or support from the Health Research Authority Confidentiality Advisory Group (27).
Taken together, these provide the legal bases to link patient datasets using the service.GP practices, which provide access to the primary care data, are required to share relevant health information to support the public health response to the pandemic, and have been informed of how the service operates.This study was approved by the Health Research Authority (REC reference 20/LO/0651) and by the London School of Hygeine and Tropical Medicine Ethics Board (reference 21863).