The effect of a specialist paramedic primary care rotation on appropriate non-conveyance decisions: a controlled interrupted time series analysis ================================================================================================================================================= * Richard Pilbery * Tracey Young * Andrew Hodge ## Abstract **Introduction** NHS ambulance service conveyance rates in the UK are almost 70%, despite an increase in non-emergency cases. This is increasing the demands on crowded emergency departments (ED) and contributes to increased ambulance turnaround times. Yorkshire Ambulance Service introduced a specialist paramedic (SP) role to try and address this, but non-conveyance rates in this group have not been as high as expected. **Methods** We conducted a controlled interrupted time series analysis of appropriate non-conveyance rates in the 12 months before and after an SP primary care placement, using matched groups of patients cared for by SPs and control paramedics. A costing analysis examined the average cost per appropriate non-conveyance and the cost-effectiveness ratio between groups. **Results** Between June 2017 and December 2019 there were 7349 incidents attended by intervention group SPs and eligible for inclusion. Following removal of cases with missing data, 5537/7349 (75.3%) cases remained. Post-placement, the intervention group demonstrated an increase in appropriate non-conveyance rate by 32.2% (95%CI 20.1–44.3%, p<0.001) and a reduction in the trend of appropriate non-conveyance relative to the control group of −1.8% (95%CI −3.5—0.0%, p=0.045). Post-placement, the cost per appropriate non-conveyance for intervention paramedics was a mean of £501.94 (95% bootstrapped CI £477.99–£526.46) versus £1217.89 (95% bootstrapped CI £1121.49–£1321.85) for the control group. This represents a mean saving of £715.95 per appropriate non-conveyance (95% bootstrapped CI £638.23–£795.69) for SPs compared to the control group, and a cost-effectiveness ratio of £2226.04 per percentage increase in appropriate non-conveyance (95% bootstrapped CI £1854.11–£2748.44). **Conclusion** In this single UK NHS ambulance service study, we found a clinically important and statistically significant increase in appropriate non-conveyance rates by specialist paramedics who had completed a 10-week GP placement. This improvement persisted for the 12-month period following the placement and demonstrated cost savings compared to usual care. Keywords * Paramedic rotation * Urgent care * Safe non-conveyance ## Introduction The National Health Service (NHS) in the United Kingdom is facing a 5% year-on-year increase in demand for urgent and emergency care services [1]. In 2018/19, ambulance services in England provided a face-to-face assessment to nearly 7.9 million incidents, of which 5.4 million were conveyed to hospital [2]. This non-conveyance rate of nearly 70% is occurring despite an increase in non-emergency cases and continues to place increasing demands on already crowded emergency departments (EDs), leading to decreased availability of ambulances as turnaround times at hospitals increase [3]. ED overcrowding is a significant issue for patients, resulting in poorer quality of care, increased healthcare costs and potentially, increased mortality [4–7]. Yorkshire Ambulance Service NHS Trust (YAS) have been early adopters of initiatives to respond appropriately to the increase in non-emergency cases, with the introduction of advanced paramedics working in the role of Emergency Care Practitioners (ECP) since 2004 [8]. Even without selective dispatching, ECPs consistently have non-conveyance rates double that of other paramedics in the Trust. Since 2015, the specialist paramedic (SP) role has been introduced in YAS, with education comprising of a 1 year university program. However, during the time period of this study (2017–2019), YAS SP non-conveyance rates were around 37.5%, compared to the overall non-conveyance rate of 30%. In contrast, ECPs had non-conveyance rates of over 59% for all call categories. In 2018, Health Education England (HEE) funded a pilot scheme to rotate paramedics into a range of healthcare settings, with the aim of improving patient care and relieving pressures on primary care, ambulance services and other parts of the NHS in a sustainable way [9]. A subsequent economic evaluation estimated that the rotating paramedics could save in the region of £275,000 per year in avoidable conveyance and subsequent admission to hospital compared to historic controls. However, data from Yorkshire included 5 ECPs who participated in the pilot and the analysis did not adjust for the difference in patient acuity between the pre- and post-placement phases [10]. The HEE pilot also presented an opportunity to further develop the decision-making of SPs, with the potential to deliver patient and cost-benefits that were anticipated when the role was created. This study aimed to evaluate whether a primary care placement appropriately increases the level and trend of non-conveyance decisions made by SPs compared to a matched control population of YAS paramedics in a cost-effective manner. ### Objectives The primary objective was to determine the change and trend in proportion of appropriate non-conveyance decisions by specialist paramedics who have completed a 10-week placement in a General Practitioner (GP) practice. The secondary objective was to compare the cost-effectiveness of specialist paramedics who have completed a 10-week placement in a GP practice compared to a matched control group of YAS paramedics. ## Methods This study was a natural experiment using routinely collected observational data. We utilised a controlled interrupted time series (CITS) analysis method to detect any change in the level and trend of appropriate non-conveyance decisions by SPs and paramedics. The cost-effectiveness analysis examined the cost per appropriate non-conveyance achieved for patients receiving care from SPs who have completed a 10 week placement in a GP practice compared with those receiving usual care from paramedics and SPs who did not undertake the 10 week placement. In addition, we calculated the cost-effectiveness ratio to determine the difference in cost between groups per percent increase in appropriate non-conveyance. National reporting of non-conveyance rates describe the proportion of patients who call 999 and are not transported to ED. If a resource e.g. ambulance is not sent to scene, this call is classed as a ‘hear and treat’ call. However, if an ambulance is sent to scene but the patient is not subsequently transported to hospital, this is classed as a ‘see and treat’ call. SPs participating in the YAS HEE pilot, did not have the opportunity to undertake ‘hear and treat’ calls and so non-conveyance for the purpose of this study, refers only to ‘see and treat’ calls. ### Setting YAS provides 24-hour emergency and health care services for the county of Yorkshire in the north of England. The county has a population of approximately five million, spread over almost 6000 square miles of varied terrain, included isolated moors and dales, coastline and heavily populated urban areas. In 2018/19 YAS received more than 998,500 emergency calls and responded to 798,968 incidents by either sending clinicians to scene or by providing assessment and advice over the telephone. #### Specialist paramedic rotation YAS employs approximately 118 SPs and 33 ECPs. In the Leeds area, 5 ECPs and 10 SPs worked with a number of primary care organisations. The ECPs and SPs rotated between providing a home visiting service for 15 GP surgeries for 10 weeks, followed by front line operations, either responding to 999 calls or working in the emergency operations centre (EOC) staffing a dedicated dispatch desk for SPs. ### Data sources We used routinely collected computer aided dispatch (CAD) and patient record data to identify all cases attended by the 10 SPs who had completed a GP placement in the Leeds area. For operational reasons, these placements were staggered, with the first paramedics entering the rotation in June 2018 and the final paramedics completing their placements at the end of December 2018. In order to obtain sufficient data pre- and post-pilot, all cases attended by these paramedics in the 12 month period prior to the placement commencing and 12 months after the placement had completed were obtained. To count as an ‘attendance’, the SPs name had to appear on the patient record. To take account of case-mix and paramedic experience in the pre- and post-placement phase, a matched comparison (control) group consisting of cases in Yorkshire covering the period from the 1st June, 2017 to 31st December, 2019 was obtained. This cohort of patients received a face-to-face assessment by paramedics and SPs who did not take part in the GP rotation. Since YAS does not keep a record of paramedic registration beyond the current 2-year registration cycle, it was not possible to determine how long staff had been registered as a paramedic using data from the Service. Instead, we identified when staff were first entered into the Health and Professions Council (HCPC) paramedic register. ### Study variables We hypothesised that appropriate non-conveyance was likely to increase following the 10-week placement, but needed to ensure that we took account of factors previously identified as being important when pre-hospital clinicians make non-conveyance decisions [11]. To achieve this, we aimed to match the control and intervention groups on the following variables: * Patient: * – Age (5 year increments) * – Sex * – Working impression (as determined by paramedic on scene) * – Time of call (in-hours/out-of-hours) * – Call category * – Call month and year * – Lowest National Early Warning Score (NEWS) threshold * Location (lower super output area, LSOA): * – Urban/rural * – Index of multiple deprivation decile * – Proportion of population within LSOA with a long-term physical or mental illness (0–4%, 4–8%, 8–12%) * Paramedics * – Years registered as a paramedic (<1 year, 1–5 years, >5 years) * – Role designation at time of incident. Since the ambulance service does not routinely capture outcome data for all patients, we pragmatically defined appropriate non-conveyance as any patient episode where the patient was not transferred to hospital and no further calls were made to the ambulance service in the following 72 hours. ### Matching Matching was performed utilising a genetic algorithm and computed using the R statistics package ‘Matching’ [12]. Genetic algorithms are a subgroup of evolutionary computing which as the name suggests, imitate biological processes of reproduction and natural selection to solve according to ‘fitness’ [13]. The ‘Matching’ package uses this algorithm to find the optimal balance between groups by examining the cumulative probability distribution functions of a variety of standardised statistics such as t-tests and Kolmogorov-Smirnov tests. Cases where the patient record could not be located or where data was missing were excluded. With the exception of ECPs (who were removed since their non-conveyance rates are consistently higher than other clinicians), it was not possible to accurately determine what role designation paramedics in the control group had. As a result, this had to be removed as a matching variable. ### Statistical methods #### Sample size calculation The sample size was constrained by the fact that this was an observational study with only 12 months pre- and post-placement available. Based on a previous audit of 999 call data, we anticipated that there would be approximately 700 patient episodes per month. Given that the time series analysis covered a 24 month time period in total, it was anticipated that approximately 33,600 incidents would be included in the dataset. #### Summary of baseline data Descriptive statistics were used to summarise the data pre- and post-placement and between intervention group SPs and the control group, to illustrate the success of matching. Median and interquartile ranges were reported for continuous variables, and counts and proportions reported for categorical data. #### Primary outcome analysis We conducted a retrospective analysis of appropriate non-conveyance before and after the GP placement, using segmented regression as part of a CITS design [14]. Since the SP placements were staggered, the actual month and year was not utilised. Instead, the number of months before and after the placement were used, so that month 1 was the month that occurred 12 months prior to the GP placement for all SPs and month 24, the month that occurred 12 months after the placement. It was anticipated that this would remove or reduce any autocorrelation. However, we checked for auto-regression and moving averages by performing the Durbin-Watson test and by plotting autocorrelation function and partial autocorrelation function plots. Coefficients from the model were used to predict the absolute change and trend in appropriate non-conveyance following the GP placement. #### Secondary outcome analysis Salary costs were calculated for the 10 week GP placement and divided by the number of incidents attended by SPs to calculate a per-incident cost. SPs were assumed to be salaried at NHS Agenda for Change mid-band 6, which was £31,121 for 2018/19. Education costs were not included since all SPs had already undertaken the education component prior to the HEE pilot commencing. The resource use related to the 999 call handling, dispatch of an ambulance, cost of conveyance and admission to the ED was calculated using reference costs published by NHS Improvement [15] (Table 1). For example, a non-conveyance would comprise the cost of answering a 999 call and cost of sending an ambulance (see and treat). In the event that a recall was made within 72 hours, the total cost for the non-conveyance would be the 999 call, ambulance (see and treat) plus the cost of the second call i.e. 999 call and ambulance (see and treat or see, treat and convey plus ED attendance). View this table: [Table 1:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/T1) Table 1: Unit costs to the NHS for ambulance 999 calls Bootstrapping was used to estimate uncertainty (reported as 95% bootstrapped confidence intervals) around cost estimates. Costs of those patients seen by intervention group SPs was compared with matched controls and the results presented as the cost per appropriate conveyance and cost-effectiveness ratio. ## Results As part of the HEE rotational paramedic pilot, 10 SPs undertook a 10 week placement in a primary care setting in the Leeds area. Five commenced their placement in June 2018, with a further three starting in August 2018 and the final two starting their placement in October 2018. Between 1st June 2017 and 31st December, 2019 there were 8849 incidents attended by one of the intervention group SPs. Once data was adjusted to remove any cases during the 10 week GP placement, and outside of the 12 months prior to the start of the rotation and 12 months after the end of the rotation, 7349 cases remained. A further 6 had no sex recorded, 15 had no age recorded and 8 had no post code, leaving 7326/7349 (99.7%) cases. A further 4 cases were excluded due to a missing index of multiple deprivation decile (3 cases), rural urban classification (3 cases) and/or prevalence of missing long-term condition data (4 cases), leaving 7322/7349 (99.6%) cases. Finally, no working impression was included in 1785 cases, resulting in a final dataset of 5537/7349 (75.3%) cases for inclusion in the final analysis. Due to the high number of missing working impressions, a sensitivity analysis was performed excluding the working impression as a variable (Appendix 1). ### Matched dataset for analysis The matching algorithm utilised 5198/5537 (93.9%) cases. Overall, the control group was closely matched to the rotational paramedic (intervention group) incidents (defined as less than 10% in standardised mean difference). Only the NEWS risk category and prevalence of long-term conditions were outside this limit. ### Pre- and Post-rotation exploratory data analysis In addition to the substantial reduction in number of cases attended in the post-placement phase, there were also other differences in pre- and post-placement cases, which could have contributed to the change in rate of non-conveyance, validating the decision to include a matched control (Table 2). View this table: [Table 2:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/T2) Table 2: Comparison of matched control and rotational paramedic groups, stratified by pre and post-placement phases Operational activity was higher pre-placement (Figure 1), since intervention group SPs had to undertake a range of additional activities in the post-placement phase, including staffing a dedicated SP dispatch desk in EOC and working in GP practices as part of the HEE pilot (Table 3). Post-placement, there were also differences in triage call category (a marker of perceived acuity following telephone triage of the call), and physiological acuity based on the NEWS risk category that the SPs were tasked to attend (Figures 2 and 3). View this table: [Table 3:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/T3) Table 3: SP daliy activity (exluding leave and days off) stratified by pre- and post-placement time periods ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/13/2020.08.06.20169334/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/F1) Figure 1: Number of incidents attended by rotating SPs in pre- and post-placement phases, stratified by month ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/13/2020.08.06.20169334/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/F2) Figure 2: Call category pre- and post-placement ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/13/2020.08.06.20169334/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/F3) Figure 3: NEWS category pre- and post-placement ### Time series Figure 4 illustrates the change in raw and fitted CITS model data between the pre- and post-placement phase. There was no indication of auto-regression, where future values are based on past values (Durbin-Watson statistic 2.37, p=0.79). Post-placement, the intervention group significantly increased their appropriate non-conveyance rate by 35.0% (95%CI 23.8–46.2%, p=<0.001) relative to the control group (Table 4). However, there was a non-statistically significant decrease in the trend of appropriate non-conveyance relative to the control group of −1.2% (95%CI −2.8–0.5%, p=0.156). The sensitivity analysis (excluding working impression as a matching variable) demonstrated a smaller increase appropriate non-conveyance in the intervention group relative to the control group of 27.1% (95%CI 16.4–37.7%, p<0.001), and smaller decrease in the trend of appropriate non-conveyance (−0.9%, 95%CI −2.4–0.6%, p=0.247). ![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/13/2020.08.06.20169334/F4.medium.gif) [Figure 4:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/F4) Figure 4: Effect of 10-week primary care placement on appropriate non-conveyance. a) Monthly appropriate non-conveyance rates b) Fitted CITS model. Dashed lines represent the counterfactuals (what would have happened in the absence of the intervention). View this table: [Table 4:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/T4) Table 4: Result of segmented regression analysis for appropriate non-conveyance ### Economic analysis Post-placement, the cost per appropriate non-conveyance for intervention paramedics was a mean of £509.42 (95% bootstrapped CI £485.94–£535.41) versus £1124.41 (95% bootstrapped CI £1041.89–£1218.31) for the control group. This represents a mean saving of £615 per appropriate non-conveyance (95% bootstrapped CI £545.31–£686.69) for intervention group SPs compared to the control group and a cost-effectiveness ratio of £1758.89 per percentage increase in appropriate non-conveyance (95% bootstrapped CI £1477.76–£2133.08). The sensitivity analysis (excluding working impression) calculated the mean post-placement cost per appropriate non-conveyance for intervention group SPs to be £528.2 (95% bootstrapped CI £504.04–£554.81) versus £1078.29 (95% bootstrapped CI £1002.63–£1162.04) for the control group. This represents a mean saving of £550.09 per appropriate non-conveyance (95% bootstrapped CI £489.79–£616.15) for intervention group SPs compared to the control group and a cost-effectiveness ratio of £2032.74 per percentage increase in appropriate non-conveyance (95% bootstrapped CI £1674.07–£2546.84). ## Discussion In this single NHS ambulance service study, we found a clinically important and statistical significant increase in appropriate non-conveyance of patients following a 10-week GP practice placement. In addition, this intervention proved to be cost saving compared to usual care. These results needs to be interpreted with caution, since they only include data from a single ambulance service with less than 10% of all paramedics currently in the role of SP. Training and experiential opportunities do vary between organisations, in part likely due to the piecemeal way in which the advanced practice roles have evolved for paramedics in the UK [9]. YAS has been commissioning the education of SPs with local Higher Education Institutions since 2014, with a focus on minor illness and injury, and long-term conditions, which is likely to resonate with other similar schemes [16]. Furthermore, YAS have continued to work to develop their workforce model aligned to the College of Paramedics post-registration career framework since 2015 [17]. There were differences in the acuity and working impressions of patients between pre- and post-GP placement, supporting the choice of methodology for this study. Since cases were matched, it is possible to see how the control group of paramedics also achieved increased rates of appropriate non-conveyance when tasked to cases allocated a lower triage call category and NEWS risk category (Table 2). However, even when accounting for case matching, intervention group SPs had a 35% improvement in appropriate non-conveyance compared to the control group. In addition, there were lower proportions of certain types of working impressions, such as acute cardiac and convulsions, and higher proportions for others, such as falls and minor injuries, reflecting dedicated tasking by SPs staffing a dispatch desk in EOC. It is possible that these proportions may have had a greater difference had the desk not closed in June 2019, perhaps reflecting the increased number of incidents attended by SPs in the final 3 months of the post-placement period. This may also correlate with the non-statistically significant drop in non-conveyance rates and increase in acuity of triage call categories seen at the same time. Overall, SPs attended less cases in the post-placement phase. In addition to attending 999 calls, intervention group SPs also fulfilled other roles, including rotating back into GP surgeries (18% of post-placement hours) and staffing the desk in EOC (29.9%). This resulted in a drop in time responding to 999 calls from 84.4% pre-placement to 60.6% after (Table 3). While availability for operational shifts reduced, the improved appropriate non-conveyance rates suggest that ambulance services should focus on EOC processes to maximise appropriate dispatching for specialist and advanced practice roles to 999 calls. The non-conveyance rates seen in this study are difficult to compare with other reported statistics, since the population included in this study is different to all emergency call activity. For example, in the intervention group’s pre-placement phase, there was a higher proportion of category 1 and 2 calls (75–76.9%) compared to YAS figures reported nationally (64%), but a lower proportion post-placement, due to greater case selection with the introduction of the dedicated SP tasking desk [18]. During the study period, YAS ‘see and treat’ rates were between 22.9–25.4% which was lower than the English average of 29.3–30.7% [19]. An evaluation of the first phase of the rotating paramedic pilot reported non-conveyance rates of at least 70%, which mirrors the performance of rotating advanced paramedics in Wales [20]. Two sites in the rotating paramedic pilot had non-conveyance rates in excess of 90%, however these schemes were primary care focused, rather than fully ambulance service based, highlighting the different models commissioned during the pilot. Further evaluation is required to understand the most appropriate model for a paramedic rotation that benefits all parts of the system. In YAS, the integration into the primary care teams during the Leeds rotation enabled the SPs to develop a greater understanding of the local healthcare system as they navigated pathways across community and acute care. This knowledge could then be utilised when the SPs rotated back into YAS and either responding to 999 calls or working in the EOC to identify appropriate 999 calls for an SP response. However, the impact of improved clinical knowledge and greater understanding of local pathways, and their effect on clinical practice and decision-making is uncertain, and requires further research. Despite this, the value of paramedics being afforded the opportunity to undertake a primary care placement has been demonstrated in this study and supports the qualitative findings from the HEE evaluation. This suggests that support and education from GPs, an appreciation of primary care and other health and social care agencies and the opportunity to develop inter-service, multi-disciplinary relationships across the health and social care system, are beneficial to patient care [10]. ### Limitations It is important to acknowledge this study’s limitations. We used routine observational data rather than conducting a randomised-controlled trial for example, which was not possible since the rotation had already completed on commencement of this work. The outcome of this study, while patient focused, could not capture episodes where patients presented to other sectors of the healthcare system as a result of a complication of not being conveyed to hospital. In addition, identifying re-contacts, relied on identification of cases either by NHS number or a combination of patient name, age and incident location which may have been missing on subsequent calls. The number of missing working impression codes was not anticipated, and so no contingency was made in the methodology to account for this. While the sensitivity analysis showed that this is likely to have had a modest impact on our findings, in retrospect this study would have been more robust with a plan to take account of this. Finally, it became apparent once the data was provided that determining the grade of paramedic with any certainty was not possible, which may have inflated the performance of the control group by inclusion of SPs who had not taken part in the HEE pilot. ## Conclusion In this single UK NHS ambulance service study, we found a clinically important and statistically significant increase in appropriate non-conveyance rates by specialist paramedics who had completed a 10-week GP rotation. This improvement persisted for the 12-month period following the rotation and demonstrated cost savings compared to usual care. ## Data Availability Permission has not been provided to make the original dataset available. However the scripts to undertake the analysis and a synthetic data set are available from the study GitHub repository: [https://github.com/RichardPilbery/SPRAINED](https://github.com/RichardPilbery/SPRAINED). [https://github.com/RichardPilbery/SPRAINED](https://github.com/RichardPilbery/SPRAINED) ## Contributors RP, TY and AH conceived and designed the study. RP obtained the research approvals and acts as guarantor for the paper. All authors drafted the manuscript and contributed substantially to its revision. ## Funding This paper presents independent research by the NIHR Applied Research Collaboration Yorkshire and Humber (ARC YH). ## Disclaimer The views expressed in this publication are those of the author(s) and not necessarily those of the National Institute for Health Research or the Department of Health and Social Care. ## Data sharing Permission has not been provided to make the original dataset available. However the scripts to undertake the analysis and a synthetic data set are available from the study GitHub repository: [https://github.com/RichardPilbery/SPRAINED](https://github.com/RichardPilbery/SPRAINED). ## Acknowledgements This work uses data provided by patients and collected by the NHS as part of their care and support. The authors would also like to thank the Yorkshire Ambulance service business intelligence team who collated the data used in this study. ## Appendix A Due to the high number of missing working impressions, we conducted a sensitivity analysis including data that was matched without working impression as a variable. Figure 5 shows the change in proportion of appropriate non-conveyance in this group and can be compared with Figure 4. The results of the segmented regression can be seen in Table 5. ![Figure 5:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/13/2020.08.06.20169334/F5.medium.gif) [Figure 5:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/F5) Figure 5: Effect of 10-week primary care rotation on appropriate non-conveyance (excluding working impression). a) Monthly appropriate non-conveyance rates b) Fitted CITS model. Dashed lines represent the counterfactuals. View this table: [Table 5:](http://medrxiv.org/content/early/2020/10/13/2020.08.06.20169334/T5) Table 5: Result of segmented regression analysis for appropriate non-conveyance (excluding working impression) ## Footnotes * Typo and inaccurate figure amended in the introduction. * Received August 6, 2020. * Revision received October 13, 2020. * Accepted October 13, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. National Audit Office. NHS Ambulance Services. National Audit Office. 2017. [https://www.nao.org.uk/report/nhs-ambulance-services/](https://www.nao.org.uk/report/nhs-ambulance-services/) (accessed 22 Oct 2019). 2. NHS England. Ambulance Quality Indicators Data 2018-19. 2019. [https://www.england.nhs.uk/statistics/statistical-work-areas/ambulance-quality-indicators/ambulance-quality-indicators-data-2018-19/](https://www.england.nhs.uk/statistics/statistical-work-areas/ambulance-quality-indicators/ambulance-quality-indicators-data-2018-19/) (accessed 22 Oct 2019). 3. Willett K, Benger J. Addressing ambulance handover delays. 2017. [https://www.england.nhs.uk/wp-content/uploads/2017/11/ambulance-handover-letter.pdf](https://www.england.nhs.uk/wp-content/uploads/2017/11/ambulance-handover-letter.pdf) (accessed 10 Oct 2019). 4. Sun BC, Hsia RY, Weiss RE et al. Effect of Emergency Department Crowding on Outcomes of Admitted Patients. Annals of emergency medicine 2013;61:05–611.e6. doi:10.1016/j.annemergmed.2012.10.026 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.annemergmed.2012.10.026&link_type=DOI) 5. Guttmann A, Schull MJ, Vermeulen MJ et al. Association between waiting times and short term mortality and hospital admission after departure from emergency department: Population based cohort study from Ontario, Canada. BMJ 2011;342:d2983. doi:10.1136/bmj.d2983 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDIvanVuMDFfMS9kMjk4MyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzEwLzEzLzIwMjAuMDguMDYuMjAxNjkzMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 6. Bernstein SL, Aronsky D, Duseja R et al. The Effect of Emergency Department Crowding on Clinically Oriented Outcomes. Academic Emergency Medicine 2009;16:1–10. doi:10.1111/j.1553-2712.2008.00295.x [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1553-2712.2008.00295.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19007346&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F13%2F2020.08.06.20169334.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000262047000001&link_type=ISI) 7. Richardson DB. Increase in patient mortality at 10 days associated with emergency department overcrowding. The Medical Journal of Australia 2006;184:213–6. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.5694/j.1326-5377.2006.tb00204.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16515430&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F13%2F2020.08.06.20169334.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000236572500005&link_type=ISI) 8. Mason S. Developing a community paramedic practitioner intermediate care support scheme for older people with minor conditions. Emergency Medicine Journal 2003;20:196–8. doi:10.1136/emj.20.2.196 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZW1lcm1lZCI7czo1OiJyZXNpZCI7czo4OiIyMC8yLzE5NiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzEwLzEzLzIwMjAuMDguMDYuMjAxNjkzMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 9. Turner J, Williams J. An Evaluation of early stage development of rotating paramedic model pilot sites. 2018. [https://www.hee.nhs.uk/sites/default/files/documents/Feasability%20Study%20of%20the%20Rotating%20Paramedics%20Pilot%20-%20Final.pdf](https://www.hee.nhs.uk/sites/default/files/documents/Feasability%20Study%20of%20the%20Rotating%20Paramedics%20Pilot%20-%20Final.pdf) (accessed 10 Oct 2019). 10. Health Education England. Rotating Paramedic Pilot: Evaluation report. 2019. 11. O’Cathain A, Knowles E, Bishop-Edwards L et al. Understanding variation in ambulance service non-conveyance rates: A mixed methods study. Health Services and Delivery Research 2018;6:1–192. doi:10.3310/hsdr06190 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3310/hsdr06190&link_type=DOI) 12. Sekhon JS. Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching package for R. Journal of Statistical Software 2011;42:1–52. doi:10.18637/jss.v042.i07 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.18637/jss.v042.i07&link_type=DOI) 13. Mitchell M. An introduction to genetic algorithms. Cambridge, Mass:: MIT Press 1996. 14. Penfold RB, Zhang F. Use of Interrupted Time Series Analysis in Evaluating Health Care Quality Improvements. Academic Pediatrics 2013;13:S38–44. doi:10.1016/j.acap.2013.08.002 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.acap.2013.08.002&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24268083&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F13%2F2020.08.06.20169334.atom) 15. NHS Improvement. National Cost Collection for the NHS. 2020. [https://improvement.nhs.uk/resources/national-cost-collection/](https://improvement.nhs.uk/resources/national-cost-collection/) (accessed 22 Jul 2020). 16. Hodge A, Swift S, Wilson JP. Maintaining competency: A qualitative study of clinical supervision and mentorship as a framework for specialist paramedics. British Paramedic Journal 2018;3:10–5. doi:10.29045/14784726.2018.12.3.3.10 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.29045/14784726.2018.12.3.3.10&link_type=DOI) 17. College of Paramedics. Post-registration paramedic career framework -4th edition. 2018. [https://collegeofparamedics.co.uk/COP/ProfessionalDevelopment/post\_reg\_career\_framework.aspx](https://collegeofparamedics.co.uk/COP/ProfessionalDevelopment/post_reg_career_framework.aspx) (accessed 1 Jun 2020). 18. NHS England. Ambulance Response Programme Review. 2018. [https://www.england.nhs.uk/wp-content/uploads/2018/10/ambulance-response-programme-review.pdf](https://www.england.nhs.uk/wp-content/uploads/2018/10/ambulance-response-programme-review.pdf) (accessed 1 Jun 2020). 19. NHS England. Ambulance Quality Indicators. 2020. [https://www.england.nhs.uk/statistics/statistical-work-areas/ambulance-quality-indicators/](https://www.england.nhs.uk/statistics/statistical-work-areas/ambulance-quality-indicators/) (accessed 1 Jun 2020). 20. Association of Ambulance Chief Executives. Model of rotational working aims to stop ambulance trusts spinning out of control - aace.org.uk. 2019. [https://aace.org.uk/news/model-of-rotational-working-aims-to-stop-ambulance-trusts-spinning-out-of-control/](https://aace.org.uk/news/model-of-rotational-working-aims-to-stop-ambulance-trusts-spinning-out-of-control/) (accessed 1 Jun 2020).