International impact of large multi-centre surgical trials of arthroscopic subacromial decompression

Objectives To examine temporal trends in incidence of arthroscopic subacromial decompression (ASAD) surgery internationally during conduct and after publication of placebo controlled trials finding no evidence of meaningful benefit of ASAD for shoulder impingement. Design Observational study of incidence rates. Setting Large routinely collected datasets were used: outpatient data from Belgium and UK, and insurance claims and outpatient data from US. UK data were from Clinical Practice Research Datalink and Belgium and US data were from IQVIA. US and UK data spanned 2005 - 2019 and Belgium data 2011 - 2019. Participants Patients were eligible for inclusion in the study if they had at least one visit recorded in the database in a given year and cases were defined as patients undergoing ASAD for the first time in their records in a given year. Outcome measures We calculated incidence of ASAD over time, overall and stratified by age and sex. Characteristics of patients undergoing ASAD were also assessed over time. Results UK incidence has fallen since a peak of 4.7 per 10,000 person years in 2011 (when the CSAW trial began) to 1.8 in 2019. US incidence shows no clear pattern and remains consistently higher than the UK, at 11.5 per 100,000 person years in 2019. Changes in incidence patterns were similar across different age groups and sexes. The number of cases in Belgium was too small for meaningful conclusions. Conclusions We found ASAD rates have fallen in the UK during conduct and after publication of two large surgical RCTs from the UK and Finland that questioned the effectiveness of ASAD for shoulder impingement. A similar impact on clinical practice has not been seen in US. Further work to understand the barriers or concerns preventing international uptake of high quality evidence into clinical practice is needed.


Introduction
Evidence-based medicine requires that high-quality evidence be translated into widespread clinical practice. Randomised surgical trials are increasing in frequency, yet their influence on changing surgical practice is not well characterised. In this study, we investigate the changing incidence of the most common shoulder operation (arthroscopic subacromial decompression) before, during and after the conduct of two large pragmatic randomised controlled trials[1,2] and publication of a rapid recommendation [3].
Painful shoulder is common, with a prevalence (in 2000) of 2.4% of primary care consultations in the UK [4] and 4.5 million visits to physicians in 2002 in the USA [5]. Sub-acromial pain accounts for up to 70% of all shoulder pain problems [6]. Surgical intervention by arthroscopic subacromial decompression (ASAD) is a common treatment for sub-acromial pain after failed non-operative treatment: from 2006/2007 to 2016/2017 in England its use increased by 91% from 30 to 52 procedures per 100,000, and use is higher internationally (e.g. 131 per 100,000 in Finland in 2011 [7]). This use imposes a significant economic cost, costing over £1 billion in the UK alone over a ten year period [7].
This rapid increase in ASAD surgery was accompanied by observational and interventional evidence with conflicting findings [8][9][10][11]. Two multi-centre placebo surgery controlled trials were subsequently conducted and published in 2018: the CSAW trial[1], recruiting in the UK from 2012 to 2015, and the FIMPACT trial [2], recruiting in Finland from 2005 to 2013. Both did not find evidence of clinically relevant differences in primary outcomes between ASAD and diagnostic arthroscopy (i.e. placebo surgery) for patients with subacromial pain and intact rotator cuff tendons. A 2019 Cochrane review, including eight trials, then found high certainty evidence that SAD does not provide clinically important benefits [12].
Anecdotal evidence of the international response in the provision of ASAD of different health care systems to these RCT findings seems to suggest that the incorporation of research evidence into practice is varied. In the UK and within 6 months of publication of the CSAW trial, NHS England put ASAD on a list of 'procedures of limited value', meaning that it should only be performed in limited circumstances [13]. In Scotland, ASAD declined consistently from 2014-2018, with the largest decrease from 2017 to 2018 coinciding with the publication of the two randomised trials [14]. However, data evaluating changes in ASAD incidence since publication of the trials in the rest of the UK are not yet available.
More broadly, international comparisons of ASAD incidence rates based on recent data are not available. Data from Florida (USA), New York (USA), Western Australia and Finland indicate that ASAD is more common than in England [7], but these data are (at the most recent) from 2013. A recent study assessing the incidence of ASAD in the US found evidence of declining use from 2010 to 2018 [15], but a similar analysis has not been conducted for the UK.
This study aimed to assess the impact of the existence and publication of major ASAD trials on surgical practice. The study used large routinely collected data sets from the US, Belgium and UK to examine the temporal trends in ASAD incidence and any trends in the characteristics of patients undergoing ASAD surgery.

Methods
This study is reported according to the STROBE reporting guideline [16].

Study design and setting
We did a retrospective study to describe ASAD incidence in Europe and the US and examined the trends in characteristics of patients undergoing ASAD. Incidence data were stratified according to age and gender, and patient characteristics were age, gender, Charlson index [17] and medicine use in the previous month (additional characteristics were examined and are given in the aggregated data on GitHub, see "Reproducibility and data availability").

3
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted November 12, 2021.

Setting and data sources
We retrieved primary care data from the UK, US and Belgium, in October and November 2020 from patients undergoing ASAD from 2005 to 2019 for the first time in their records in a given year. Follow-up time points extended from the beginning of each calendar year to the earliest of the end of that year, death, transfer out date (i.e. the date of the patient leaving the index general practice, or changing insurance providers), and ASAD surgery.
Outpatient electronic medical records (EMR) from Belgium, UK and US were collected. We additionally collected insurance claims data for the US, because US EMR data cover a much smaller fraction of the population. US and Belgium Data were from IQVIA and UK data were from Clinical Practice Research Datalink (CPRD) Gold (ISAC application #20_000245). Databases used are summarised as follows: Study sample size was determined by availability of data in each database: we used all available data.

Participants
Patients were eligible for inclusion in the cohort if they had at least one visit recorded in the database in a given year and cases were defined as patients undergoing ASAD for the first time in their records in a given year. The following codes were used to identify ASAD cases and were identified by two authors with surgical expertise (AJC and JLR): • Arthroscopic decompression of subacromial joint • Acromioplasty of shoulder • Partial acromioplasty • Arthroscopic acromioplasty • Arthroscopy, shoulder, surgical; decompression of subacromial space with partial acromioplasty, with coracoacromial ligament (ie, arch) release, when performed (List separately in addition to code for primary procedure) • Acromioplasty or acromionectomy, partial, with or without coracoacromial ligament release

Quantitative variables and statistical methods
Incidence rates of ASAD per 10,000 person years were calculated as cases*10,000/person years. Characteristics of patients undergoing ASAD were assessed at time of surgery and descriptive statistics were calculated 4 . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted November 12, 2021. ; per year in which surgery was conducted. There was no missing data (that we were able to determine) in the included databases.

Results
We obtained data from CPRD for the UK and, from IQVIA, for the US (two databases: IQVIA OpenClaims and IQVIA AEMR) and Belgium (IQVIA LPD Belgium

Outcome data
Incidence was highly variable across databases and time (Figure 1). US incidence rates were considerably higher than those in UK and Belgium. In the UK, ASAD incidence plateaued from 2010-2014, and has consistently fallen since. There was no clear pattern in US incidence over a similar time period based on analysis of claims data. Note that historical rates in the US decrease from 2011 due to a smaller number of contributing care sites represented in the database during that period of time. The most stable data is available over the last 10 years. The number of recorded cases was extremely small in Belgium so any findings need to be interpreted with caution, but there was no clear pattern in incidence over time. Despite changes in the interim period, rates at the beginning and end of the time periods studied in the US and UK were similar (2005 -2019).
Changes over time were similar within different age and sex strata of the population in US and UK data ( Figure 2; Belgium data are not shown because there were too few cases in several strata which could compromise anonymity). Males had higher rates of ASAD than females, the age group with the highest incidence was 50 to <65, and age <35 had the lowest incidence.

Discussion
We present the most comprehensive analysis of international ASAD rates to date and the first UK-wide analysis of ASAD incidence for shoulder impingement including data from 2018 and 2019, (i.e. after publication of robust trials questioning the effectiveness of ASAD). The analysis shows that UK incidence has fallen since a peak in 2011 while there is no clear pattern for the US. US rates were higher than UK rates throughout the study period and remain high.

5
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint  6 . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint  [14], a finding observed UK-wide in our study. A recent analysis of US claims data indicated that from 2010 to 2018 ASAD incidence declined by 39.6% from 118.0 to 71.3 per 100,000 [15]; we find ASAD incidence rates in a similar range but increasing by 12.9% from 10.1 to 11.4 per 10,000 person years over the same period. Real world data have different rates of capture, and there is potential subjectivity in case definitions that may contribute to variability in the the rates reported. . Interestingly, a large proportion of the decrease in ASAD happened before any results of the trials were available, potentially suggesting that the awareness over the uncertainty in the effectiveness of ASAD raised by running of the national trial contributed to the reduction, in what could be termed an "ongoing RCT effect". A paper highlighting the rapid spread of ASAD for shoulder impingement in the absence of evidence of benefit may also have contributed to the decline[18], though cannot explain it fully as it was published in 2014. It seems most plausible that a combination of these factors is responsible.

Interpretation
Reasons for the lack of change in rates in the US are unclear. It is possible that any "ongoing RCT effect" is specific to countries or populations in which trials are conducted, and that results of surgical RCTs take more time to change practice internationally than nationally, despite the international dissemination of results. However, data from Sweden suggest a decrease in ASAD similar to that observed in our study, and the results of the trials are rapidly informing clinical guidelines (personal communication, Stefan Lohmander). Clinicians in countries such as the US may not view the results of the studies conducted in UK and Finland to be generalisable to their practice; however, the patient cohorts recruited to these trials are clearly defined in the trial publications and are not unique to the country of origin.

Limitations
Database coverage and reporting of procedures changes over time, so some variation in ASAD incidence may not be attributable to real changes in ASAD surgery rates. It is challenging to address these sources of error; however, we have included data from some of the largest and most representative sources available and these limitations are applicable to any research using them. In the US data, there was discordance between incidence rates in the two data sources, with rates lower from IQVIA AEMR. Lower rates most likely reflect limited capture of these procedures in an outpatient setting. EMR data have been shown in other contexts to substantially underestimate care and utilisation [19]. We therefore included IQVIA Open Claims data only in our results.
Few cases were recorded in Belgium, which could reflect low incidence or could reflect that ASAD was not captured in the data. The latter seems more plausible since the database, LPD Belgium, largely consists of outpatient data, which is not designed to capture surgery. Regardless, the number of cases was too low to draw meaningful conclusions about trends in patient characteristics or incidence. Also, we tried but were unable to retrieve incidence data for Germany, France, and Italy with the instantiated cohort definitions.
However, open SAD is much less common, for example in the US comprising only 5% of SAD surgeries performed [15]. ASADs performed as part of other shoulder operations like rotator cuff repair or resection of calcific deposit may not have been excluded with the used codes. There is inevitably a trade-off between sensitivity and specificity of codes; with two experienced shoulder surgeons helping in our cohort definition, we feel the codes used were reasonable.

Conclusions
We found evidence that the impact of the conduct and publication of two large ASAD surgical RCTs differed between the UK and the US. In the UK, ASAD rates fell both during and after completion of a large national trial. This highlights the successful engagement of surgeons and healthcare commissioners in adopting the results of the trial, and supports the ongoing commitment in the UK to fund and conduct surgical RCTs to address treatment uncertainties. While such evidence should translate internationally, it has not, and further work is needed to understand the barriers or concerns around the international uptake of high quality evidence.
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted November 12, 2021. ; https://doi.org/10.1101/2021.11.10.21266128 doi: medRxiv preprint