Abstract
Objectives To determine the effectiveness and safety of a tool diverting low urgency patients eligible for primary care from an emergency department (ED) to the adjacent general practitioner cooperative (GPC).
Methods Unblinded, randomised controlled trial with weekends serving as clusters (three intervention clusters for each control). The intervention was nurse-led triage using a new tool assigning patients to either ED or GPC. During intervention weekends, patients were encouraged to follow this assignment while it was not communicated to the patients during control weekends (they remained at the ED). The primary outcome was the proportion of patients assigned to and handled by the GPC during intervention weekends. The trial was randomised for the secondary outcome: the proportion of patients assigned to the GPC during intervention and control weekends. Additional outcomes were association of these outcomes with possible confounders (study tool parameters, nurse, and patient characteristics), proportion of patients referred back to the ED by the GPC, hospitalisations, and performance of the study tool to detect primary care eligible patients (with the opinion of the treating physician as the gold standard).
Results In the intervention group, 838/6374 patients (13.3%, 95% CI 12.5 to 14.2) were assigned to the GPC (secondary outcome), in the control group 431/1744 (24.7%, 95% CI 22.7 to 26.8). In the intervention group, 599/6374 patients (9.5%, 95% CI 8.8 to 10.3) experienced the primary outcome which was influenced by the chosen MTS presentational flowchart, patient’s age, and the nurse. 24/599 patients (4.0%, 95% CI 2.7 to 5.9) patients were referred back to the ED of which three were hospitalised. Positive and negative predictive values of the studied tool during intervention weekends were 0.96 (95%CI 0.94 to 0.97) and 0.60 (95% CI 0.58 to 0.62). Out of the patients assigned to the GPC, 2.4% (95% CI 1.7 to 3.4) were hospitalised.
Conclusions ED nurses using a new tool safely diverted 9.5% of the included patients to primary care.
ClinicalTrials.gov Identifier NCT03793972
Funding Research Foundation – Flanders (FWO)
Introduction
In many countries, Out-of-hours (OOH) primary care is increasingly organised in General Practitioner Cooperatives (GPCs), and simultaneously, emergency care is provided by emergency departments (EDs) in hospitals. Although there is no clear definition of ‘appropriate’ or ‘inappropriate’ use of the ED, several authors reported that many medical problems presented at the ED could be managed in a primary care setting.[1-4] In the United States, primary care office visits for acute care dropped sharply in 2002-15, while ED visits increased modestly.[5] In Belgium, an ED has the legal obligation to assess and to treat all patients with an emergency medical condition regardless of an individual’s ability to pay, which is very similar to the Emergency Medical Treatment & Labor Act in the United States.[6] Patients choose a service based on previous experiences, ease of access, explanation by the doctor about the illness and treatment, the anticipated waiting time, their relationship with their general practitioner (GP), and the perceived nature of the complaint.[7] Diverting patients in emergency departments to primary care services helps patients to make this choice, but little is known about its safety and effectivity.[8-10] Both patients and physicians in Belgium are in favour of co-locating these services.[11] Improved access to OOH primary care was associated with increased primary care utilisation, but did not necessarily lead to a decrease of workload at the ED.[9]
Triage is defined as the sorting out and classification of patients or casualties to determine priority of need (urgency classification) and proper place of treatment (in the current study assignment to ED or GPC).[12] Before this trial, almost all EDs in Belgium used nurse triage to determine priority and place of treatment within the hospital but diverging patients to a GPC was only done in experimental settings.[13] The Manchester Triage System (MTS) is one of the few triage systems with a moderate to good validity, it is used worldwide.[13] Three small non randomised trials about the MTS and diversion to primary care revealed promising results.[14-16] An awareness-raising campaign was conducted as a pilot for the current study in order to collect baseline data, to assess the feasibility of local cooperation and to estimate the needed sample size.[18]
The objective of the current study was to determine the effectiveness and safety of a nurse triage tool diverting low-risk patients who presented at an ED during OOH care to the adjacent GPC. The trial design is a clustered randomised trial with weekends and bank holidays (from here out we refer to weekends and bank holidays as weekends) serving as units of randomisation and patients as units of analysis. Individual randomisation was not desirable because the triage process is by nature applied to a longer period of at least one working shift. A process and economic analysis of the present trial will be published separately.
Material and Methods
Study design, setting and participants
Single centre randomised controlled trial from 01/03/2019 to 30/12/2019. Weekends (7.00 PM Friday to 6.00 AM Monday) served as units of randomisation (approximately 200 participants each) and patients as units of analysis. A preparation period of two months for adapting the software, testing procedures, and training the staff was followed by the actual study (01/03/2019 to 30/12/2019).
This study was performed in the ED of a general hospital staffed by approximately 25 nurses and 10 physicians handling 36 743 contacts in 2018. The adjacent GPC, which is open during OOH care, covers a population of 145 000 inhabitants and handled 10 586 consultations in 2018. All 110 GPs working in the area covered by this GPC are obliged to work there approximately one shift per month. The surrounding area is ethnically diverse with a mix of middle-income and socially deprived neighbourhoods. The Belgian healthcare system is organised into primary, secondary, and tertiary care, with open access for patients to all levels. It is mainly organised as a fee-for-service system.
All patients with a national insurance number triaged by a nurse at the ED were included. Patients arriving at the ED by an ambulance staffed with a doctor or nurse, patients already admitted to the hospital, and patients referred to the ED by a doctor were excluded because they already underwent triage. See S12 Research Protocol. for the entire study protocol and S13 Minor changes to the study protocol.
Study tool
The MTS (version 3.6) is a tool for prioritisation in the ED. When using the MTS, the nurse chooses one out of 53 presentational flowcharts (e.g., abdominal pain in children). A flowchart consists of a list of discriminators (e.g., mild pain), the presence of which has to be checked in a top-down order. Each discriminator is linked to an urgency category ranging from one (immediate care necessary) to five (non-urgent).
For the current study, an extended version of the MTS (eMTS) was created. First, a questionnaire was distributed to a working group consisting of three GPs, two ED-nurses, and two ED physicians. Next, the working group drafted the eMTS during five consensus meetings. The aim of this tool is to identify low-urgency patient eligible for primary care. Due to legal concerns, only patients in urgency categories four and five were allowed to be assigned to the GPC but not all of them are eligible for primary care as some might need hospital care (radiology, complex interventions, hospitalisation. For example, a patient with a deformed joint with mild pain probably needs hospital care (radiology) but has a low urgency category. The working group chose to allow assignment to the GPC when an expected 90% of the GPs would be able to safely help the patient. Wounds requiring sutures for example were assigned to the ED. Babies less than three months old were always assigned to the ED, as some of the GPs might not have enough paediatric experience.
Nine MTS flowcharts were not extended. In 18 flowcharts, additional discriminators were created which had to be assessed whenever the urgency category was four or five. Presence of one of these additional discriminators means an assignment to the ED (see Fig 1 for an example). In 26 flowcharts, the only added discriminator was “GP Risk”, defined as an unspecified risk to assign the patient to the GPC according to the opinion of the triaging nurse, or because of age less than three months. The eMTS was integrated into a computer decision support system (E.care ED 4.1) that showed “assign to GPC” when appropriate. The nurses were allowed to overrule the result of this automated eMTS assignment. The eMTS is available upon request.
Intervention
All patients presenting at the ED were triaged by an experienced nurse using the eMTS, resulting in an urgency level (one to five) and an assignment (to GPC or to ED). The study was only conducted during OOH care as there were no centralised primary care services available during working hours. In a Belgian observational study, only 1.7% of the GPC patients were in need of urgent hospital care so patients presenting at the GPC were not triaged in the current study.[19] During control weekends the assignment was not communicated to the patients, they all remained at the ED. During intervention weekends patients were encouraged to comply to the assignment but were allowed to refuse it. Patients were informed in the ED about the study using flyers, posters, and a presentation broadcasted on a screen. During intervention weekends, this presentation contained additional information in five languages about the possibility of being assigned to the GPC. All nurses followed a twelve-hour training on using the eMTS, patient communication skills, and the study protocol. In one-hour sessions, the researchers informed emergency physicians (participation 80%) and GPs (participation 33%) about the study.
Outcomes
The primary outcome (effectiveness) was the proportion of patients assigned to the GPC and handled by the GPC during intervention weekends. The secondary outcome was the proportion of patients assigned to the GPC during intervention and control weekends. Additional outcomes were the proportion of patients who did not comply to the assignment; the association between the primary and secondary outcomes and possible confounders (study tool parameters, nurse, patient characteristics, and timing of presentation); proportion of patients within the primary outcome referred back to the ED; admissions to the study hospital; and performance of the eMTS as an instrument to detect patients primary care patients (i.e., a low risk of hospital care). The exploration of the primary outcome after the trial ended was the only outcome not pre-specified, it was added to exclude a Hawthorne effect (the changes in behaviour found are caused by the impact of being studied, not by the intervention).[20]
Sample Size
The impact size of the determinants of the primary and secondary outcomes were unknown prior to this study but were estimated to be in the order of 10-20%. Therefore, based on known volumes of inflow of patients, two weekends (one intervention and one control) would have been sufficient to provide empirical evidence of a statistically significant shift of patients from the ED to the GPC. However, multivariate analyses of the primary and secondary outcome, the additional outcomes (safety), monitoring of serious adverse events and assessment of a possible learning curve required data collection over a longer period of time. Consequently, a convenience sample of 48 weekends months was selected.
Randomisation
Because the primary outcome did not apply to the control group (the study needed randomisation for the secondary outcome and for future financial and process analysis), and because more data on the intervention weekends were needed to assess the additional outcomes, a ratio of three intervention weekends for each control was chosen. The trial intentionally started with two intervention weekends. The authors used an algorithm in Microsoft Excel 2016 to generate random allocation stratified for bank and school holidays, while no more than five consecutive intervention weekends were allowed. The head nurse and one assistant were aware of the randomisation. The ED staff were informed a few hours before their shift. The GPC staff were not informed but could find out during their shift. Patients were not blinded.
Data collection
The following patient characteristics were collected: sex; birthyear; postal code; socioeconomic status (reimbursement status of the Belgian health insurance: increased reimbursement or not); type of admission to the ED (walk-in, arrived by ambulance, or already admitted to hospital); origin (self-referral, referral by GP, referral by specialist); ED physician’s post hoc opinion on assignment (to GP or to ED); GP referral back to the ED; admission to the study hospital, and triaging nurse (anonymous identifier ranging from one to 22). After triage, the following study tool parameters were collected: MTS flowchart (52 flowcharts reported in 15 categories); eMTS discriminator; MTS urgency level (one to five), and assignment (ED or GPC). The timing of presentation was registered both at the ED and, when applicable, at the GPC. It had three characteristics: weekend identifier, time period (day, evening, or night), and subjective crowding at the ED (quiet, normal, and busy). Except the subjective crowding, all variables were part of the routine medical records.
In order to calculate the complete number of exclusions, the number of patients without a national insurance number was extracted from the ED’s software. All other data were collected using iCAREdata, a database for OOH care.[20, 21] iCAREdata links data from the ED and the GPC to each other using the pseudonymised national insurance number.
The studied intervention continued after the trial upon request of the participating sites, but a decline in the quality of the ED registrations made some registrations unreliable. To explore the primary outcome after the trial ended, the number of patients originating from the ED as noted by the GPC receptionist was extracted from the GPC’s software (Mediris 2.4) both for the study period and one year afterwards. Because the COVID-19 pandemic disrupted the Belgian healthcare system mainly during two waves, the months April, November, and December 2020 were excluded.[22]
Ethics
Ethical clearance waiving individual informed consent was obtained from the ethics committee of Antwerp University Hospital (reference 18/37/410) and from the local ethics committee of AZ Monica Deurne (reference 367).
Monitoring
One and six months after the start of the trial, the research team presented interim results to the working group that prepared the study. All staff members and the hospital’s ombudsperson were asked to report all serious adverse events possibly related to the study.
Patient and public involvement
A lay person volunteering at the ED of a hospital not participating in this study was involved in the study design, she gave advice about the study protocol and tool. An advisory board with stakeholders from EDs, GPCs and universities gave advice about the study design, discussed the interim analysis, and gave feedback on the results.
Analysis
Bivariate logistic regression was used to calculate odds ratios (OR) of the dichotomous outcomes across multilevel categorical independent variables. Those variables found significant (alpha = 0.05) in the bivariate analysis were incorporated in the multivariate analysis. This multivariate analysis was started by creating three chi-square automatic interaction detection (CHAID) decision trees.[23, 24] Decision tree methodology is a data mining method used for developing prediction algorithms of a dichotomous target variable taking into account the interactions of the independent variables. The algorithm is non-parametric, can efficiently deal with large, complicated datasets, and can accept missing values. Decision trees based on Bonferroni-Holms corrected chi-square tests were constructed separately for the study tool parameters, patient characteristics and timing of presentation (weekend, time period, subjective crowding). K-fold cross validation was used to protect against overfitting. A final decision tree was fitted using the significant variables as they turned out in the three separate analyses. The significant variables in the decision trees were entered in a generalised mixed model considering that observations are nested in nurses, that is, with the nurse as a random intercept. To compare the primary outcome during the study period to the year 2020, an unpaired samples student’s t-test was used. Details about the statistical analysis and data cleaning can be found in S14 Statistical Analysis Plan.
IBM SPSS version 26 was used for the CHAID analysis. The generalised linear model was created in Jamovi version 1.6 using the GAMLj module.[26] The epiR package in R version 4.0 was used to calculate predictive values with a 95% CI.[27] For all other analysis, JMP pro version 15 was used.
Results
Study population
In this study, 9964 patients were assessed for eligibility, of which 1806 patients were excluded mostly because of the lack of a national insurance number or because they were already triaged (Fig 2). The intervention group consisted of 6374 patients (78.1%) clustered in 37 weekends. The control group consisted of 1784 (21.9%) patients clustered in 10 weekends. On one bank holiday allocated to the intervention group, the study was unintentionally not conducted. The baseline characteristics of the patients in the intervention and in the control group were similar except for the subjective crowding at the ED (Table 1).
Out of the 22 nurses, five nurses worked significantly less during control weekends (lowest OR, 0.12 95%CI 0.04 to 0.38, p<0.01) and seven worked significantly more (highest OR, 3.63 95%CI 2.91 to 4.68).
Primary outcome
For 80 out of the 6374 participants in the intervention group the assignment was unknown; almost half of them (n=34) left without being seen, the others were seen at the ED. These 80 patients were excluded from the following analysis. Out of the remaining patients, 838/6294 (13.3%, 95% CI 12.5 to 14.2) were assigned to the GPC, 196/838 (23.4 %, 95%CI 20.6 to 26.4) refused this assignment, 43/642 (6.7% 95%CI 5.0 to 8.9) accepted the assignment but left without being seen. The primary outcome was 599/6374 (9.5%, 95% CI 8.8 to 10.3). See Table 2 for the bivariate analysis of the primary outcome.
The most important determinants of the primary outcome were MTS urgency category (non-urgent versus standard, OR 2.96), MTS flowchart category (ORL (otorhinolaryngology) complaints versus unwell adult OR 3.91), patient’s age (above 74 years versus 40-54 years, OR 0.33), admission type (arrived by ambulance versus walk-in OR 0.05), subjective crowding at the ED (quiet versus normal OR 2.16), and nurse (nurse four versus nurse nine OR 3.56).
CHAID analysis of the study tool parameters (S1 Supplementary Figure 1) showed that the urgency category was primordial: none of the patients in the three highest urgency categories was seen at the GPC, and more patients from urgency category five were diverted to the GPC as compared to urgency category four. Within urgency category four, the flowchart category became a determining factor. Abdominal complaints, ORL complaints, neurological complaints, respiratory complaints, children, unwell adult, and back neck pain led to the GPC in more than 30% of the cases, while limb problems, wounds, chest pain, eye problems, and mental complaints led to the GPC in 5.2% of the low urgency cases. CHAID analysis of the patient characteristics (S1 Supplementary Figure 2) revealed admission type as the crucial factor, followed by socioeconomic status, residence, and age as the least determining variable. Finally, CHAID analysis of the timing of presentation (see S3 supplementary Figure 3) showed that during the day, the proportion of the primary outcome was lower when the subjective crowding was normal (7.5%) compared to quiet and busy ED (10.7%). A combined CHAID tree (Fig 3) demonstrates the pivotal role of the study tool components. Only in a selection of flowcharts the admission type and the time period played a significant role.
A comparison of the fixed effects generalised linear model (deviance 2200.6, df 53, AIC 2306.8, BIC 2636.7) with the generalised mixed model (deviance 2523.6, df 27, AIC 2577.6, BIC 2745.7) led to rejection of the nurse’s random effect in favour of the fixed effects model. In the generalised linear model (for patients within the urgency categories four and five only, N= 3735, mean primary outcome 16%), all variables had a significant effect on the primary outcome (pseudo R-squared .22), with the largest contribution by the MTS flowchart category (S10 Supplementary table 3).
Secondary outcome
During the intervention weekends, assignment to the GPC was recorded for 838 out of 6294 patients (13.3%, 95% CI 12.5 to 14.2); during control weekends this proportion was almost twice as high: 431/1744 (24.7%, 95% CI 22.7 to 26.8). Bivariate analysis (S8 Supplementary table 1) and CHAID analysis (S4-S6 Supplementary figure 4-6) of the secondary outcome gave results similar to the primary outcome, but the intervention became the most important determinant after the study tool components. The nurses overruled the automated eMTS assignment in 4.2% (95% CI 3.6-4.7) of the cases within urgency category four and five.
Other outcomes
Patients within the primary outcome referred back to the ED
Out of the 599 patients within the primary outcome, the GPs referred 24 patients (4.0%, 95% CI 2.7 to 5.9) back to the ED (S9 Supplementary table 2.). The proportion of these referrals was not significantly influenced by the triaging nurse, the patient’s characteristics, or the weekend. Four out of the 19 patients with a presentational flowchart category ‘neurological complaints’ were referred back to the ED, which was significantly higher compared to the reference category ‘unwell adult’ (OR 7.2 95% CI 1.2 to 43.2).
One potential serious adverse event was reported, a middle-aged male complaining of mild back pain presented at the ED at 2.00 PM. He was diverted to the GP who prescribed an analgesic and reassured him. Thirty minutes later a taxi brought the patient, who was having a cardiac arrest, back to the ED. During unsuccessful resuscitation a ruptured abdominal aneurysm was diagnosed. After assessing the records of this patient and an interview with the involved staff, the working group judged that the management of this patient would not have been different if he had been assigned to the ED.
Admissions to the study hospital
The overall proportion of hospitalised patients was 1309/8038 (16.3% 95% CI 15.5 to 17.1). This proportion was 31/1236 (2.4% 95% CI 1.7 to 3.4) among patients with an assignment to the GPC. It was not influenced by the intervention (P= 0.56). Among the 599 patients in the primary outcome, three (0.5% 95% CI 0.2 to 1.5) were admitted to the hospital.
Performance of the study tool to detect primary care patients
Patients without a known assignment to GPC or ED (n=120) were excluded from this analysis. During intervention weekends, patients who refused the assignment (n=200) were also excluded. For patients within the primary outcome (n=599), the gold standard was referral by the GP. Patients referred back to the ED were considered “false positive” (n=24), the others true positives (n=575) leading to a positive predictive value of 0.96 (95% CI 0.94, 0.97). For patients who accepted assignment to the ED (n=5452), the gold standard was the opinion of the ED physician: false negative when these patients were eligible for primary care (n=797) or true negative when these patients were not (n=1196). The negative predictive value was 0.60 (95% CI0.58, 0.62).
During control weekends the gold standard was the opinion of the ED physician. The positive and negative predictive values were 0.84 (95% CI 0.78, 0.90) and 0.56 (95% CI 0.51, 0.60) respectively. The opinion of the ED physician was not registered at the ED in 4549/7196 (63%) of the patients. Eight out of the 24 physicians provided 94% of the values.
Exploration of the primary outcome after the trial ended
The primary outcome during the intervention weekends calculated on the GPC data was 645, on average 16 patients (standard deviation 8.8) per weekend. In 2020, it remained 16 (standard deviation 6.4, p=0.43).
Discussion
In this trial, 838 (13%) out of the 6374 included patients in the intervention group were assigned to the GPC, of which 599 (71%) were seen at the GPC. Four percent of these patients were referred back to the ED. The primary outcome was mostly influenced by the study tool parameters: urgency category and chosen presentational flowchart. The remaining variability can be explained by factors related to the patient (mostly arriving by ambulance), the triaging nurse, and the timing of presentation. The secondary outcome was roughly influenced by the same determinants. During control weekends, this secondary outcome doubled. The positive and negative predictive values of the studied tool for detecting primary care patients were 0.96 and 0.60 during intervention weekends. The effectiveness remained unchanged after the trial, suggesting that the study induced longer-lasting structural changes in the triage and referral processes.
This study was the first cluster-randomised trial about diverting ED patients to primary care. Its strengths lie in the large number of included patients, its real live setting, and its long study period. This study has the universal limitations of a cluster-randomised trial, such as the possibility of undetected imbalance among the study groups, interactions between individuals triaged after each other, and clustering of population characteristics on certain weekends. It was conducted in a single centre adapted to some local habits. The working group was not an independent data monitoring committee as they all worked in the studied services. The opinion of the ED physician about the assignment was well registered, but by a minority of the physicians, making the calculated predictive values prone to observer bias. There was an imbalance between intervention and control groups for the subjective crowding at the ED. This was probably due to a difference in motivation to register this parameter rather than due to an actual difference. An important difference between the studied tool and the original MTS is the discriminator GP Risk which allows a subjective judgment of the triaging nurse, this might reduce generalisability although it resembles every day practice where nurses use their gut feelings.[28]
A large study found a 22% increase of the proportion of patients attending the GP with a close collaboration with the ED as compared to the usual care setting, while another study found a decline in the number of patients treated at the ED by 20% after the introduction of a nearby GPC.[28, 29] These results are similar to the secondary, but not the primary, outcome of the current study, so the effectiveness of the studied tool was rather low. Whether or not it is desirable to increase this primary outcome depends on whether the perspective is from the third-party payer, the patient, the service, or the healthcare professionals. This question will be answered in the upcoming process and financial analysis of the current study. Diverting 10% of the included patients to primary care reduced the workload at the ED, but the current study does not allow quantification of this impact. It might influence patient and staff satisfaction; a qualitative study about this aspect will be reported in the near future. The intervention might influence the long-term health seeking behaviour of patients as it is know that patients who were given the opportunity to be treated at a primary care clinic instead of an ED have increased future primary care follow-up compared with standard ED referral practices.[31] The higher primary outcome when the subjective crowding at the ED is quiet indicates that the ability of the studied tool to reduce crowding at the ED might be lower when it is needed the most.
The referral rate of patients in the primary outcome to the ED (4%) was similar to the referral rate of the studied GPC for untriaged patients (6%) and in general practice OOH services in the United Kingdom (8.1%). A retrospective study in which all self-referred, low-urgency patients were diverted to the GPC, found a referral rate back to the ED of 20%.[31] The lower referral rate in the current study is probably due to the design of the studied tool. The power of the analysis of the patients referred back to the ED was limited due to their small number. The very low admission rate, both for patients within the primary outcome as for patients with an assignment to the GPC is an indicator of safety. The positive predictive value for an assignment to the GPC of 0.96 in the intervention and 0.84 in the control group is another indicator of safety. Because the studied tool seems safe for patients refusing an assignment to the GPC, it might be interesting to study the possibility to oblige patients to follow an assignment to the GPC. Long-term multicentre studies are necessary to confirm these safety findings in larger populations.
During intervention weekends, the number of patients left without being seen was higher in the group assigned to the GPC than in the group assigned to the ED. The authors received some anecdotal information about patients attending their own GP after the weekend but were not able to study what happened to all of these patients.
Most of the risk factors for the primary outcome (age, presentational flowchart, and timing of presentation) found in the multivariate analysis cannot be influenced by policy so the tool itself should be the focus for improvement. This seems feasible as the nurses followed the studied tool in 96% of the cases. The presentational flowchart ‘limb problems’ has the greatest potential as the nurses indicated a risk for referral to the GP in 1322/1803 (73%) low urgency cases mostly because they thought the patient needed radiology or sutures. In contrast to walk-in patients, those arriving with an ambulance had telephone triage before arriving at the ED. The low proportion of the primary and secondary outcome in these patients implies that is not useful to use studied tool afterwards. The differences in the primary outcome among nurses should be studied further and can be addressed by training. The higher primary outcome during the night demands further study: is it related to patient or nurse factors?
The secondary outcome was much higher in the control group than in the intervention group. It is probably easier for a nurse to write down a theoretical assignment to the GPC compared to discussing it with the patient. Qualitative and quantitative follow-up studies about this aspect will be reported soon. Training of the nurses might improve their ability to engage with patients to discuss the proper place of treatment.
Only one serious adverse event was reported but it had a fatal outcome so further safety monitoring of the studied intervention is necessary.
Conclusion
In this randomised trial about triaging patients to primary care, ED nurses using a new tool safely diverted 9.5% of the included ED patients to the GPC. Young patients arriving without an ambulance with a typical primary care presentation were more often assigned to the GPC. These results remained stable after the end of the trial.
Data Availability
The studied data is available to researchers worldwide after following the application procedures of iCAREdata (see www.icaredata.eu). Given the privacy policy of the iCAREdata database, the authors are not allowed to share the used data as supporting information or in a public repository. Sharing this database would potentially harm the privacy of the included patients. The Belgian Data Protection Authority does not allow the authors to share the raw data. The authors are, however, able to deliver a selection of variables and the outputs of their statistical software upon reasonable request.
Supporting information captions
S1 Supplementary Figure 1. Primary Outcome - Chi-square automatic interaction detection (CHAID) decision tree of the study tool parameters
MTS: Manchester Triage System
ORL: Otorhinolaryngology
S2 Supplementary Figure 2. Primary Outcome - Chi-square automatic interaction detection (CHAID) decision tree of the patient characteristics
S3 Supplementary figure 3. Primary Outcome - Chi-square automatic interaction detection (CHAID) decision tree of the timing of presentation
S4 Supplementary figure 4. Secondary Outcome - Chi-square automatic interaction detection (CHAID) decision tree of the study tool parameters
ED: Emergency Department
GP: General Practice
MTS: Manchester Triage System
ORL: Otorhinolaryngology
S5 Supplementary figure 5. Secondary Outcome - Chi-square automatic interaction detection (CHAID) decision tree of the patient characteristics
ED: Emergency Department
GP: General Practice
S6 Supplementary figure 6. Secondary Outcome - Chi-square automatic interaction detection (CHAID) decision tree of the timing of presentation
ED: Emergency Department
GP: General Practice
S7 Supplementary figure 7. Secondary Outcome - Chi-square automatic interaction detection (CHAID) combined decision tree
ED: Emergency Department
GP: General Practice
MTS: Manchester Triage System
ORL: Otorhinolaryngology
S8 Supplementary table 1. Bivariate analysis of the secondary outcome (all participants excluding those with a missing triage advice). For categorical variables with more than four categories, the categories with the highest and lowest secondary outcome are reported.
DF: degrees of freedom
MTS: Manchester Triage System
ED: Emergency Department
ORL: Otorhinolaryngology
*: Only for urgency categories four and five because the primary outcome was zero in the other categories
S9 Supplementary table 2. Characteristics of patients referred back to the ED after triage to the GPC.
ED: Emergency Department
GP: General Practitioner
MTS: Manchester Triage System
S10 Supplementary table 3. Generalised Mixed Model for the primary outcome.
MTS: Manchester Triage System
Df: degrees of freedom
S11 Supplementary table 4. Presentational flowchart categories.
ORL: Otorhinolaryngology
S12 Research Protocol. Original research protocol.
S13 Minor changes to the study protocol. Overview of the minor changes made to the study protocol after trial registration.
S14 Statistical Analysis Plan.
Acknowledgments
The authors would like to thank Carolyn Daher for proofreading the manuscript, all participating healthcare providers at the emergency department of AZ Monica Deurne, the staff of the general practice cooperative Antwerp East and specially Sander Naeyaert, Ragna Verlent, Joo-Ree Melis, Marc Timmermans, Arnoud Bonemeyer, Edwin Vanbeveren, Lotte Fivez and Guido Michielsen for their extensive help and advice.