Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Eleven key measures for monitoring general practice clinical activity during COVID-19 using federated analytics on 48million adults’ primary care records through OpenSAFELY

View ORCID ProfileLouis Fisher, View ORCID ProfileHelen J. Curtis, View ORCID ProfileRichard Croker, View ORCID ProfileMilan Wiedemann, View ORCID ProfileVictoria Speed, View ORCID ProfileChristopher Wood, Andrew Brown, View ORCID ProfileLisa EM Hopcroft, View ORCID ProfileRose Higgins, View ORCID ProfileJon Massey, View ORCID ProfilePeter Inglesby, View ORCID ProfileCaroline E. Morton, View ORCID ProfileAlex J. Walker, Jessica Morley, View ORCID ProfileAmir Mehrkar, View ORCID ProfileSeb Bacon, View ORCID ProfileGeorge Hickman, View ORCID ProfileOrla Macdonald, Tom Lewis, Marion Wood, Martin Myers, Miriam Samuel, Robin Conibere, Wasim Baqir, Harpreet Sood, Charles Drury, View ORCID ProfileChris Bates, View ORCID ProfileDavid Evans, Iain Dillingham, Tom Ward, View ORCID ProfileSimon Davy, Rebecca M. Smith, View ORCID ProfileWilliam Hulme, View ORCID ProfileAmelia Green, John Parry, Frank Hester, Sam Harper, View ORCID ProfileJonathan Cockburn, View ORCID ProfileShaun O’Hanlon, View ORCID ProfileAlex Eavis, View ORCID ProfileRichard Jarvis, View ORCID ProfileDima Avramov, View ORCID ProfilePaul Griffiths, View ORCID ProfileAaron Fowles, Nasreen Parkes, View ORCID ProfileBrian MacKenna, View ORCID ProfileBen Goldacre
doi: https://doi.org/10.1101/2022.10.17.22281058
Louis Fisher
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Louis Fisher
Helen J. Curtis
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Helen J. Curtis
Richard Croker
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Richard Croker
Milan Wiedemann
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Milan Wiedemann
Victoria Speed
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Victoria Speed
Christopher Wood
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Christopher Wood
Andrew Brown
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lisa EM Hopcroft
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lisa EM Hopcroft
Rose Higgins
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Rose Higgins
Jon Massey
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jon Massey
Peter Inglesby
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Peter Inglesby
Caroline E. Morton
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Caroline E. Morton
Alex J. Walker
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alex J. Walker
Jessica Morley
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amir Mehrkar
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Amir Mehrkar
Seb Bacon
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Seb Bacon
George Hickman
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for George Hickman
Orla Macdonald
2Oxford Health Foundation Trust, Warneford Hospital, Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Orla Macdonald
Tom Lewis
3Royal Devon University Healthcare NHS Foundation Trust, Barnstaple, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marion Wood
4NHS England, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martin Myers
5Lancashire Teaching Hospitals NHS Foundation Trust, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Miriam Samuel
6Queen Mary University of London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robin Conibere
7Beacon Medical Group, Plymouth, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wasim Baqir
4NHS England, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Harpreet Sood
8Sternhall Lane Surgery, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Charles Drury
9Herefordshire and Worcestershire Health and Care NHS Trust, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chris Bates
10TPP, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Chris Bates
David Evans
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David Evans
Iain Dillingham
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tom Ward
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Simon Davy
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Simon Davy
Rebecca M. Smith
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William Hulme
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for William Hulme
Amelia Green
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Amelia Green
John Parry
10TPP, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frank Hester
10TPP, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sam Harper
10TPP, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan Cockburn
10TPP, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jonathan Cockburn
Shaun O’Hanlon
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Shaun O’Hanlon
Alex Eavis
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alex Eavis
Richard Jarvis
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Richard Jarvis
Dima Avramov
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Dima Avramov
Paul Griffiths
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Paul Griffiths
Aaron Fowles
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Aaron Fowles
Nasreen Parkes
11EMIS, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian MacKenna
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
4NHS England, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brian MacKenna
  • For correspondence: brian.mackenna@phc.ox.ac.uk
Ben Goldacre
1The Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, OX2 6GG, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ben Goldacre
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background The COVID-19 pandemic has had a significant impact on delivery of NHS care. We have developed the OpenSAFELY Service Restoration Observatory (SRO) to describe this impact on primary care activity and monitor its recovery.

Objectives To develop key measures of primary care activity and describe the trends in these measures throughout the COVID-19 pandemic.

Methods With the approval of NHS England we developed an open source software framework for data management and analysis to describe trends and variation in clinical activity across primary care electronic health record (EHR) data on 48 million adults.

We developed SNOMED-CT codelists for key measures of primary care clinical activity selected by a expert clinical advisory group and conducted a population cohort-based study to describe trends and variation in these measures January 2019-December 2021, and pragmatically classified their level of recovery one year into the pandemic using the percentage change in the median practice level rate.

Results We produced 11 measures reflective of clinical activity in general practice. A substantial drop in activity was observed in all measures at the outset of the COVID-19 pandemic. By April 2021, the median rate had recovered to within 15% of the median rate in April 2019 in six measures. The remaining measures showed a sustained drop, ranging from a 18.5% reduction in medication reviews to a 42.0% reduction in blood pressure monitoring. Three measures continued to show a sustained drop by December 2021.

Conclusions The COVID-19 pandemic was associated with a substantial change in primary care activity across the measures we developed, with recovery in most measures. We delivered an open source software framework to describe trends and variation in clinical activity across an unprecedented scale of primary care data. We will continue to expand the set of key measures to be routinely monitored using our publicly available NHS OpenSAFELY SRO dashboards with near real-time data.

Competing Interest Statement

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare the following: BG has received research funding from the Laura and John Arnold Foundation, the NHS National Institute for Health Research (NIHR), the NIHR School of Primary Care Research, NHS England, the NIHR Oxford Biomedical Research Centre, the Mohn-Westlake Foundation, NIHR Applied Research Collaboration Oxford and Thames Valley, the Wellcome Trust, the Good Thinking Foundation, Health Data Research UK, the Health Foundation, the World Health Organisation, UKRI MRC, Asthma UK, the British Lung Foundation, and the Longitudinal Health and Wellbeing strand of the National Core Studies programme; he is a Non-Executive Director at NHS Digital; he also receives personal income from speaking and writing for lay audiences on the misuse of science. R Conibere declares Honoraria for Work with Primary Care Pharmacy Association. MS is an NIHR funded academic clinical fellow in primary care. MM is NHS GIRFT Senior Clinical Advisor for Pathology.

Funding Statement

This research used data assets made available as part of the Data and Connectivity National Core Study led by Health Data Research UK in partnership with the Office for National Statistics and funded by UK Research and Innovation (grant ref MC_PC_20058). In addition, the OpenSAFELY Platform is supported by grants from the Wellcome Trust (222097/Z/20/Z); MRC (MR/V015757/1, MC_PC-20059 MR/W016729/1); NIHR (NIHR135559, COV-LT2-0073) and Health Data Research UK (HDRUK2021.000 2021.0157). BG has also received funding from: the Bennett Foundation; the Wellcome Trust; NIHR Oxford Biomedical Research Centre; NIHR Applied Research Collaboration Oxford and Thames Valley; the Mohn-Westlake Foundation; all Bennett Institute staff are supported by BG grants on this work. BMK is employed by NHS England and seconded to the Bennett Institute. The views expressed are those of the authors and not necessarily those of the NIHR, NHS England, UK Health Security Agency (UKHSA) or the Department of Health and Social Care. Funders had no role in the study design, collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This study was approved by the Health Research Authority (REC reference 20/LO/0651).

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Access to the underlying identifiable and potentially re-identifiable pseudonymised electronic health record data is tightly governed by various legislative and regulatory frameworks, and restricted by best practice. The data in OpenSAFELY is drawn from General Practice data across England where EMIS and TPP are the data processors. EMIS and TPP developers initiate an automated process to create pseudonymised records in the core OpenSAFELY database, which are copies of key structured data tables in the identifiable records. These pseudonymised records are linked onto key external data resources that have also been pseudonymised via SHA-512 one-way hashing of NHS numbers using a shared salt. Bennett Institute for Applied Data Science developers and PIs holding contracts with NHS England have access to the OpenSAFELY pseudonymised data tables as needed to develop the OpenSAFELY tools. These tools in turn enable researchers with OpenSAFELY data access agreements to write and execute code for data management and data analysis without direct access to the underlying raw pseudonymised patient data, and to review the outputs of this code. All code for the full data management pipeline, from raw data to completed results for this analysis and for the OpenSAFELY platform as a whole is available for review at github.com/opensafely-core and github.com/opensafely/sro-measures.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted October 17, 2022.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Eleven key measures for monitoring general practice clinical activity during COVID-19 using federated analytics on 48million adults’ primary care records through OpenSAFELY
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Eleven key measures for monitoring general practice clinical activity during COVID-19 using federated analytics on 48million adults’ primary care records through OpenSAFELY
Louis Fisher, Helen J. Curtis, Richard Croker, Milan Wiedemann, Victoria Speed, Christopher Wood, Andrew Brown, Lisa EM Hopcroft, Rose Higgins, Jon Massey, Peter Inglesby, Caroline E. Morton, Alex J. Walker, Jessica Morley, Amir Mehrkar, Seb Bacon, George Hickman, Orla Macdonald, Tom Lewis, Marion Wood, Martin Myers, Miriam Samuel, Robin Conibere, Wasim Baqir, Harpreet Sood, Charles Drury, Chris Bates, David Evans, Iain Dillingham, Tom Ward, Simon Davy, Rebecca M. Smith, William Hulme, Amelia Green, John Parry, Frank Hester, Sam Harper, Jonathan Cockburn, Shaun O’Hanlon, Alex Eavis, Richard Jarvis, Dima Avramov, Paul Griffiths, Aaron Fowles, Nasreen Parkes, Brian MacKenna, Ben Goldacre
medRxiv 2022.10.17.22281058; doi: https://doi.org/10.1101/2022.10.17.22281058
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Eleven key measures for monitoring general practice clinical activity during COVID-19 using federated analytics on 48million adults’ primary care records through OpenSAFELY
Louis Fisher, Helen J. Curtis, Richard Croker, Milan Wiedemann, Victoria Speed, Christopher Wood, Andrew Brown, Lisa EM Hopcroft, Rose Higgins, Jon Massey, Peter Inglesby, Caroline E. Morton, Alex J. Walker, Jessica Morley, Amir Mehrkar, Seb Bacon, George Hickman, Orla Macdonald, Tom Lewis, Marion Wood, Martin Myers, Miriam Samuel, Robin Conibere, Wasim Baqir, Harpreet Sood, Charles Drury, Chris Bates, David Evans, Iain Dillingham, Tom Ward, Simon Davy, Rebecca M. Smith, William Hulme, Amelia Green, John Parry, Frank Hester, Sam Harper, Jonathan Cockburn, Shaun O’Hanlon, Alex Eavis, Richard Jarvis, Dima Avramov, Paul Griffiths, Aaron Fowles, Nasreen Parkes, Brian MacKenna, Ben Goldacre
medRxiv 2022.10.17.22281058; doi: https://doi.org/10.1101/2022.10.17.22281058

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Primary Care Research
Subject Areas
All Articles
  • Addiction Medicine (215)
  • Allergy and Immunology (495)
  • Anesthesia (106)
  • Cardiovascular Medicine (1094)
  • Dentistry and Oral Medicine (195)
  • Dermatology (141)
  • Emergency Medicine (274)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (500)
  • Epidemiology (9760)
  • Forensic Medicine (5)
  • Gastroenterology (480)
  • Genetic and Genomic Medicine (2304)
  • Geriatric Medicine (222)
  • Health Economics (462)
  • Health Informatics (1554)
  • Health Policy (734)
  • Health Systems and Quality Improvement (602)
  • Hematology (236)
  • HIV/AIDS (501)
  • Infectious Diseases (except HIV/AIDS) (11636)
  • Intensive Care and Critical Care Medicine (616)
  • Medical Education (236)
  • Medical Ethics (67)
  • Nephrology (257)
  • Neurology (2140)
  • Nursing (134)
  • Nutrition (336)
  • Obstetrics and Gynecology (426)
  • Occupational and Environmental Health (517)
  • Oncology (1173)
  • Ophthalmology (363)
  • Orthopedics (128)
  • Otolaryngology (220)
  • Pain Medicine (145)
  • Palliative Medicine (50)
  • Pathology (309)
  • Pediatrics (694)
  • Pharmacology and Therapeutics (298)
  • Primary Care Research (266)
  • Psychiatry and Clinical Psychology (2173)
  • Public and Global Health (4649)
  • Radiology and Imaging (775)
  • Rehabilitation Medicine and Physical Therapy (456)
  • Respiratory Medicine (623)
  • Rheumatology (274)
  • Sexual and Reproductive Health (225)
  • Sports Medicine (210)
  • Surgery (250)
  • Toxicology (43)
  • Transplantation (120)
  • Urology (94)