TY - JOUR T1 - Data-driven identification of unusual prescribing behaviour: an analysis and interactive data tool using six months of primary care data from 6500 practices in England JF - medRxiv DO - 10.1101/2022.09.22.22280200 SP - 2022.09.22.22280200 AU - Lisa EM Hopcroft AU - Jon Massey AU - Helen Curtis AU - Brian MacKenna AU - Richard Croker AU - Orla Macdonald AU - David Evans AU - Peter Inglesby AU - Seb Bacon AU - Tom O’Dwyer AU - Ben Goldacre AU - Alex J Walker Y1 - 2022/01/01 UR - http://medrxiv.org/content/early/2022/09/23/2022.09.22.22280200.abstract N2 - Background Approaches to addressing unwarranted variation in healthcare service delivery have traditionally relied on the prospective identification of activities and outcomes, based on a hypothesis, with subsequent reporting against defined measures. Practice-level prescribing data in England are made publicly available by the NHS Business Services Authority for all general practices. There is an opportunity to adopt a more data-driven approach to capture variability and identify outliers by applying hypothesis free data driven algorithms to national datasets.Objectives To develop and apply a hypothesis free algorithm to identify unusual prescribing behaviour in primary care data at multiple administrative levels in the NHS in England, and to visualise these results using organisation-specific interactive dashboards.Methods Here we report a new data-driven approach to quantify how ‘unusual’ prescribing rates of a particular chemical within an organisation are as compared to peer organisations, over a period of six months (June-December 2021). This is followed by ranking to identify which chemicals are the most notable outliers in each organisation. These outlying chemicals are calculated for all practices, primary care networks, clinical commissioning groups and sustainability and transformation partnerships in England. Results are presented via organisation-specific interactive dashboards, the iterative development of which has been informed by user feedback.Results User feedback and internal review of case studies demonstrate that our methodology identifies chemicals that are in line with local policies and internal reporting.Conclusions Data-driven approaches overcome existing biases with regards to the planning and execution of audits, interventions and policy-making within NHS organisations, potentially revealing new targets for improved healthcare service delivery. We provide our dashboards as a candidate list for the consideration of expert users to prioritise for further interpretation and qualitative research in terms of potential targets for improved performance.Competing Interest StatementBG has received research funding from the Laura and John Arnold Foundation, the NHS National Institute for Health Research (NIHR), the NIHR School of Primary Care Research, the NIHR Oxford Biomedical Research Centre, the Mohn-Westlake Foundation, NIHR Applied Research Collaboration Oxford and Thames Valley, the Wellcome Trust, the Good Thinking Foundation, Health Data Research UK, the Health Foundation, the World Health Organisation, UKRI, Asthma UK, the British Lung Foundation, and the Longitudinal Health and Wellbeing strand of the National Core Studies programme; he also receives personal income from speaking and writing for lay audiences on the misuse of science.Funding StatementThis project is funded by the National Institute for Health Research (NIHR) under its Research for Patient Benefit (RfPB) Programme (Grant Reference Number PB-PG-0418-20036).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study used openly available human data as provided by NHS BSA (https://www.nhsbsa.nhs.uk/prescription-data/prescribing-data/english-prescribing-data-epd). These data are processed, summarised and visualised using our OpenPrescribing platform as described on our website (https://openprescribing.net/about/).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data used in the present study are publicly available at https://www.nhsbsa.nhs.uk/prescription-data/prescribing-data/english-prescribing-data-epd. Code for data management and analysis are archived online at https://github.com/ebmdatalab/openprescribing/blob/main/openprescribing/pipeline/management/commands/outlier_reports.py. The generated dashboards are available at https://openprescribing.net/labs/outlier_reports/. https://www.nhsbsa.nhs.uk/prescription-data/prescribing-data/english-prescribing-data-epd https://github.com/ebmdatalab/openprescribing/blob/main/openprescribing/pipeline/management/commands/outlier_reports.py https://openprescribing.net/labs/outlier_reports/ BNFBritish National FormularyCCGClinical Commissioning GroupGPGeneral PractitionerICBIntegrated Care BoardNHSNational Health ServicePCNPrimary Care NetworkSDstandard deviationSTPSustainability and Transformation Partnership ER -