Prognostic accuracy of emergency department triage tools for adults with suspected COVID-19: The PRIEST observational cohort study ================================================================================================================================== * Ben Thomas * Steve Goodacre * Ellen Lee * Laura Sutton * Amanda Loban * Simon Waterhouse * Richard Simmonds * Katie Biggs * Carl Marincowitz * Jose Schutter * Sarah Connelly * Elena Sheldon * Jamie Hall * Emma Young * Andrew Bentley * Kirsty Challen * Chris Fitzimmons * Tim Harris * Fiona Lecky * Andrew Lee * Ian Maconochie * Darren Walter ## Abstract **Objectives** The World Health Organisation (WHO) and National Institute for Health and Care Excellence (NICE) recommend various triage tools to assist decision-making for patients with suspected COVID-19. We aimed to estimate the accuracy of triage tools for predicting severe illness in adults presenting to the emergency department (ED) with suspected COVID-19 infection. **Methods** We undertook a mixed prospective and retrospective observational cohort study in 70 EDs across the United Kingdom (UK). We collected data from people attending with suspected COVID-19 between 26 March 2020 and 28 May 2020, and used presenting data to determine the results of assessment with the following triage tools: the WHO algorithm, NEWS2, CURB-65, CRB-65, PMEWS and the swine flu adult hospital pathway (SFAHP). We used 30-day outcome data (death or receipt of respiratory, cardiovascular or renal support) to determine prognostic accuracy for adverse outcome. **Results** We analysed data from 20892 adults, of whom 4672 (22.4%) died or received organ support (primary outcome), with 2058 (9.9%) receiving organ support and 2614 (12.5%) dying without organ support (secondary outcomes). C-statistics for the primary outcome were: CURB-65 0.75; CRB-65 0.70; PMEWS 0.77; NEWS2 (score) 0.77; NEWS2 (rule) 0.69; SFAHP (6-point) 0.70; SFAHP (7-point) 0.68; WHO algorithm 0.61. All triage tools showed worse prediction for receipt of organ support and better prediction for death without organ support. At the recommended threshold, PMEWS and the WHO criteria showed good sensitivity (0.96 and 0.95 respectively), at the expense of specificity (0.31 and 0.27 respectively). NEWS2 showed similar sensitivity (0.96) and specificity (0.28) when a lower threshold than recommended was used. **Conclusion** CURB-65, PMEWS and NEWS2 provide good but not excellent prediction for adverse outcome in suspected COVID-19, and predicted death without organ support better than receipt of organ support. PMEWS, the WHO criteria and NEWS2 (using a lower threshold than usually recommended) provide good sensitivity at the expense of specificity. **Registration** ISRCTN registry, [ISRCTN28342533](http://medrxiv.org/external-ref?link_type=ISRCTN&access_num=ISRCTN28342533), [http://www.isrctn.com/ISRCTN28342533](http://www.isrctn.com/ISRCTN28342533) ## Introduction The emergency department (ED) has a crucial role in the management of patients with suspected COVID-19. ED management involves assessing the risk of adverse outcome and the need for life-saving intervention, and then using this to determine decisions around admission to hospital and inpatient referral [1,2]. Triage tools can assist decision-making by combining information from clinical assessment in a structured manner to predict the risk of adverse outcome. Triage tools may take the form of a score, which allocates points to risk predictors to indicate an increasing risk of adverse outcome, or a rule, which uses risk predictors to determine a clinical decision, such as hospital admission or discharge. Adults and children presenting to the ED with suspected COVID-19 differ markedly in their need for hospital admission and risk of adverse outcome [3], so they require different triage tools. We focus on adults in this study. Guidelines have recommended a number of triage tools for adults with suspected COVID-19. The World Health Organisation (WHO) decision-making algorithm for acute respiratory infection [4] recommends hospital admission for severe pneumonia (respiratory rate >30/minute, oxygen saturation <90% or signs of respiratory distress) or respiratory infection associated with comorbidities (age >60, hypertension, diabetes, cardiovascular disease, chronic respiratory disease, chronic renal disease or immunocompromising conditions). The United Kingdom (UK) National Institute for Health and Care Excellence (NICE) COVID-19 rapid guideline [5] suggests that the National Early Warning Score version 2 (NEWS2) score [6] can be useful for predicting the risk of deterioration. NEWS2 uses heart rate, respiratory rate, systolic blood pressure, oxygen saturation, temperature, and conscious level to allocate a score between zero and 20. The guideline also notes that the CRB-65 tool can determine the need for hospital admission in adults with pneumonia but has not been validated in people with COVID-19. The CURB-65 pneumonia score [7] uses five variables (confusion, urea level, respiratory rate, blood pressure, and age) to generate a score between zero and five. The CRB-65 score allows use without blood testing by dropping urea measurement from the score. Triage tools developed or recommended for an influenza pandemic could be used for suspected COVID-19. Guidance during the 2009 H1N1 pandemic included a swine flu hospital pathway for ED management with seven criteria, any one of which predicts increased risk and the need for hospital assessment [8]. The Pandemic Modified Early Warning Score (PMEWS) [9] uses physiological variables, age, social factors, chronic disease, and performance status to generate a score between zero and nineteen. Triage tools need to be validated in the clinically relevant population to determine whether they accurately predict adverse outcome. We developed the Pandemic Influenza Triage in the Emergency Department (PAINTED) study following the 2009 H1N1 pandemic to evaluate triage tools for suspected pandemic influenza. We modified the PAINTED protocol to become the Pandemic Respiratory Infection Emergency System Triage (PRIEST) study in January 2020 to address any pandemic respiratory infection and include triage tools recommended for COVID-19. ## Aims and objectives We aimed to estimate the accuracy of triage tools recommended for predicting severe illness in adults presenting to the ED with suspected COVID-19 infection. ## Methods ### Design We undertook an observational study to collect standardised predictor variables recorded in the ED, which we then used to evaluate triage tools for predicting adverse outcome up to 30 days after initial hospital presentation. The study did not involve any change to patient care. Hospital admission and discharge decisions were made according to usual practice, informed by local and national guidance. ### Setting and population We identified consecutive patients presenting to the ED of participating hospitals with suspected COVID-19 infection. Patients were eligible if they met the clinical diagnostic criteria [10] of fever (≥ 37.8°C) and acute onset of persistent cough (with or without sputum), hoarseness, nasal discharge or congestion, shortness of breath, sore throat, wheezing, sneezing. This was determined on the basis of the assessing clinician recording that the patient had suspected COVID-19 or completing a standardised assessment form designed for suspected pandemic respiratory infection [11]. ### Interventions We planned to evaluate triage tools recommended for use in the COVID-19 pandemic or the 2009 H1N1 influenza pandemic, as outlined in the introduction: the WHO algorithm, NEWS2, CURB-65, CRB-65, PMEWS and the swine flu adult hospital pathway (SFAHP). The triage tools are described in Appendix 1. NEWS2 can be used as a score, with thresholds between zero and 20 on the total score, or a rule, with a single threshold of a total score greater than four or a score of three on any parameter. We therefore evaluated the performance of NEWS2 as both a score and a rule. The SFAHP has a criterion (G) that is positive if there is any clinical concern. This is difficult to judge objectively or identify from clinical records, so we evaluated the pathway in two ways: (1) A 6-point rule that did not include parameter G; (2) A 7-point rule in which parameter G was positive if the NEWS2 rule was positive. NEWS2 is widely used in the UK health service to identify clinical concern. ### Data collection Data collection was both prospective and retrospective. We provided participating EDs with a standardised data collection form that included the predictor variables used in the triage tools [11]. Participating sites could adapt the form to their local circumstances, including integrating it into electronic or paper clinical records to facilitate prospective data collection, or using it as a template for research staff to retrospectively extract data from clinical records. We did not seek consent to collect data but information about the study was provided in the ED and patients could withdraw their data at their request. Patients with multiple presentations to hospital were only included once, using data from the first presentation identified by research staff. ### Outcome measurement Research staff at participating hospitals reviewed patient records at 30 days after initial attendance to identify any adverse outcomes. Patients who died or required respiratory, cardiovascular or renal support were classified as having an adverse outcome. Patients who survived to 30 days without requiring respiratory, cardiovascular or renal support were classified as having no adverse outcome. Respiratory support was defined as any intervention to protect the patient’s airway or assist their ventilation, including non-invasive ventilation or acute administration of continuous positive airway pressure. It did not include supplemental oxygen alone or nebulised bronchodilators. Cardiovascular support was defined as any intervention to maintain organ perfusion, such as inotropic drugs, or invasively monitor cardiovascular, status, such as central venous pressure or pulmonary artery pressure monitoring, or arterial blood pressure monitoring. It did not include peripheral intravenous cannulation or fluid administration. Renal support was defined as any intervention to assist renal function, such as haemofiltration, haemodialysis or peritoneal dialysis. It did not include intravenous fluid administration. ### Analysis The primary outcome was death, or respiratory, cardiovascular or renal support, as defined above. We also planned secondary analyses using the following outcomes: (1) Respiratory, cardiovascular, or renal support, to predict need for life-saving treatment; (2) Death without respiratory, cardiovascular, or renal support, to predict poor prognosis. If triage tools are used to determine treatment decisions, such as referral to critical care, then it is helpful to know how well they predict need for treatment rather than a potentially irremediable poor prognosis. We retrospectively applied each triage tools to the data, excluding pregnant women from analysis of NEWS2. Appendix 1 provides details of scoring and handling missing data for the triage tools. For each tool we plotted the receiver-operating characteristic (ROC) curve and calculated the area under the ROC curve (c-statistic) for discriminating between cases with and without adverse outcome. We calculated sensitivity, specificity, positive predictive value and negative predictive value at the following pre-specified decision making thresholds, based on recommended or usual use: 0-1 versus 2-5 for CURB-65; 0-2 versus 3+ for PMEWS; 0-4 versus 5-20 for the NEWS2 score. The WHO algorithm and Swine Flu Hospital Pathway are positive if any criterion is positive. We used STATA (version 16) for analyses [12]. The sample size was dependent on the size and severity of the pandemic, but based on a previous study in the 2009 H1N1 influenza pandemic we estimated we would need to collect data from 20,000 patients across 40-50 hospitals to identify 200 with an adverse outcome. In the event, the adverse outcome rate in adults was much higher in the COVID-19 pandemic, giving us adequate power to undertake primary and secondary analyses. ### Patient and public involvement The Sheffield Emergency Care Forum (SECF) is a public representative group interested in emergency care research. [13] Members of SECF advised on the development of the PRIEST study and two members joined the Study Steering Committee. Patients were not involved in the recruitment to and conduct of the study. We are unable to disseminate the findings to study participants directly. ## Results The PRIEST study recruited 22485 patients from 70 EDs across 53 sites between 26 March 2020 and 28 May 2020. We included 20892 in the analysis after excluding 39 who requested withdrawal of their data, 1530 children, 7 with missing age and 17 with missing outcome data. Table 1 shows the characteristics of adults in the cohort. Some 13997 (67.0%) were admitted after ED assessment and 6521 (31.2%) ultimately tested positive for COVID-19. Overall, 4672 (22.4%) died or received organ support (primary outcome), with 2058 (9.9%) receiving organ support and 2614 (12.5%) dying without organ support (secondary outcomes). Organ support involved respiratory support for 1944 (9.3%), cardiovascular for 517 (2.5%) and renal support for 218 (1%). View this table: [Table 1:](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T1) Table 1: Characteristics of the study population Table 2 shows the results for the primary analysis, Table 3 the results for secondary analysis predicting receipt of organ support and Table 4 the results for secondary analysis predicting death without organ support. The ROC curves for these analyses are shown in Figures 1 to 3. View this table: [Table 2](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T2) Table 2 Summary of ROC analysis for existing triage tools predicting adverse outcomes View this table: [Table 3](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T3) Table 3 Summary of ROC analysis for existing triage tools predicting organ support View this table: [Table 4](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T4) Table 4 Summary of ROC analysis for existing triage tools predicting death without organ support ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/07/2020.09.02.20185892/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/F1) Figure 1: Overlaid ROC curves for triage tools predicting adverse outcome in adults ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/07/2020.09.02.20185892/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/F2) Figure 2: Overlaid ROC curves for triage tools predicting any support in adults ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/07/2020.09.02.20185892/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/F3) Figure 3: Overlaid ROC curves for triage tools predicting death without support in adults In the primary analysis, none of the triage tools showed excellent discrimination (c-statistic>0.8) but CURB-65, PMEWS, and NEWS2 showed good discrimination (>0.7). This may reflect the use of multiple points across these tools, as opposed to a single decision-making threshold for other tools. At the pre-specified threshold, PMEWS and the WHO criteria showed good sensitivity (0.96 and 0.95 respectively), at the expense of specificity (0.31 and 0.27 respectively). The sensitivities of other triage tools at the pre-specified threshold were below 0.9, albeit with higher specificities. The triage tools generally showed worse prediction for receipt of organ support and better prediction for death without organ support. This was most marked for CURB-65 and CRB-65, and least marked for NEWS2. Only NEWS2 showed good prediction for organ support (c-statistic>0.7). Supplementary Table S1 shows the sensitivity and specificity at each threshold for the triage tools with multiple potential thresholds for decision-making (CURB-65, CRB-65, PMEWS, and NEWS2). These results suggest that NEWS2 could offer good sensitivity (0.96), at the expense of specificity (0.28), if we use a score greater than one to predict adverse outcome. The sensitivity of CURB-65 is 0.90 and CRB-65 is 0.86 at the lowest threshold (any score above zero predicts adverse outcome). ## Discussion ### Summary of main findings ED clinicians usually use triage tools to support decisions, such as admission to hospital, where sensitivity needs to be optimised at the expense of specificity to avoid missed opportunities to predict and prevent adverse outcome. Our analysis suggests that the WHO algorithm or PMEWS greater than two provide good sensitivity at the expense of specificity, and could be used to support decision-making where sensitivity needs to be optimised. NEWS2 needs to use a lower threshold (any score above one) than currently recommended to achieve a comparable balance of sensitivity and specificity. The triage tools predicted death without organ support better than they predicted receipt of organ support. Only NEWS2 predicted receipt of organ support with good accuracy. This reflects NEWS2 using only physiological measures, while other triage tools include age, performance status or comorbidities that are more likely to predict death without organ support. ### Previous research Studies undertaken during the H1N1 influenza 2009 pandemic suggested that existing triage tools have suboptimal accuracy for predicting adverse outcome in acute respiratory infections, with c-statistics below 0.8 [14,-16]. Recent studies have evaluated NEWS2, CURB-65 and CRB-65 in adult inpatients with confirmed COVID-19. Fan *et al* (N=654) [17] reported c-statistics of 0.81, 0.85 and 0.80 respectively for NEWS2, CURB-65 and CRB-65 as predictors of in-hospital death. The conventional thresholds for positivity of scores above four, one and zero offered suboptimal sensitivity (0.79, 0.63 and 0.83), with corresponding specificities of 0.69, 0.91 and 0.69. Bradley et al (N=830) [18] reported c-statistics of 0.67 for NEWS2 and 0.74 for CURB-65 as predictors of 30-day mortality, with sensitivities and specificities at conventional thresholds of 0.83 and 0.37 for NEWS2, and 0.80 and 0.59 for CURB-65. Ma et al (N=305) [19] reported c-statistics of 0.79 for NEWS2 and 0.85 for CURB-65 for predicting death. Satici et al (N=681) [20] reported a c-statistic of 0.79 for predicting 30-day mortality with CURB-65, with sensitivity 0.73 and specificity 0.85 at the conventional threshold. Nguyen et al [21] reported that 36/171 (21%) patients with CURB-65 scores of zero or one died or received intensive care admission. Gidari *et al* (N=68) [22] evaluated NEWS2 as a predictor of intensive care admission and Myrstad et al (N=66) [23] evaluated NEWS2 and CRB65 as predictors of death or intensive care admission, but the small sizes produced imprecise estimates of prognostic parameters. These studies concur with our findings that the conventional thresholds for NEWS2 and CURB-65 offer inadequate sensitivity to support discharge decisions after ED assessment. The larger studies used 30-day or in-hospital mortality as their outcome. Our analysis suggests that this may overestimate prognostic accuracy if the tools are used to predict need for life-saving treatment rather than simply predicting mortality. ### Strengths and limitations We collected data from a clinically relevant population of patients presenting with suspected COVID19 across a large and varied range of EDs. The large sample size and high rate of adverse outcome allowed us to estimate parameters with a high degree of precision in primary and secondary analyses. The main limitation is that the triage tools applied to data collected from clinical record review or a standardised data collection form, rather than being applied directly to the patient by the assessing clinician. This may have led to under-estimation of the performance of the triage tool, especially when relevant data were missing. Table 1 shows that data were relatively complete for age, physiological variables and performance status, but the recording of other parameters (respiratory distress, respiratory exhaustion, dehydration) was limited by inability to determine whether the feature was not present or not recorded. This is most salient for the Swine Flu Hospital Pathway and may have led to underestimation of the sensitivity of this triage tool. Another potential limitation is that we may have missed adverse outcomes if patients attended a different hospital after initial hospital discharge. This is arguably less likely in the context of a pandemic, in which movements between regions were curtailed, but cannot be discounted. Finally, although some triage tools can be used in the prehospital or community setting, we recommend caution in extrapolating our findings to other settings, where there may be a lower prevalence of adverse outcome. ### Implications for practice Our findings suggest that the WHO algorithm or PMEWS greater than two could be used to support hospital admission decisions, providing good sensitivity at the expense of specificity. NEWS2 would need to use a threshold greater than one to achieve a similar balance of sensitivity and specificity. If a triage tool is used to select patients for higher levels of treatment, rather than simply predict risk of adverse outcome, then NEWS2 offers better discrimination than other triage tools. Use of triage tools for this purpose may also require a different balance of sensitivity and specificity, with a higher threshold being used to ensure higher levels of care are reserved for those most likely to benefit. In general, however, the accuracy of the triage tools evaluated was far from optimal, especially for predicting receipt of organ support. This is arguably unsurprising since they were developed for a variety of purposes and none were derived using data from patients presenting to the ED with suspected COVID-19. Research to derive and validate triage tools specific for COVID-19 is therefore an urgent priority. ### Ethical approval The North West - Haydock Research Ethics Committee gave a favourable opinion on the PAINTED study on 25 June 2012 (reference 12/NW/0303) and on the updated PRIEST study on 23rd March 2020. The Confidentiality Advisory Group of the Health Research Authority granted approval to collect data without patient consent in line with Section 251 of the National Health Service Act 2006. ### Competing interests All authors have completed the ICMJE uniform disclosure form at [www.icmje.org/coi\_disclosure.pdf](http://www.icmje.org/coi_disclosure.pdf) and declare: grant funding to their employing institutions from the National Institute for Health Research; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work. ## Data Availability Anonymised data are available from the corresponding author upon reasonable request (contact details on first page). The Confidentiality Advisory Group of the Health Research Authority will need to consider any requests for data to be used for purposes other than those specified in our application, so a data request should be accompanied by explanation of the purpose of the request and justification of the public benefit. We also recommend inclusion of a pre-specified plan of analysis. ## Contributor and guarantor information SG, AB, KC, CF, TH, FL, ALe, IM and DW conceived and designed the study. BT, KB, ALo, SW, RS, JS, SC, ES, JH and EY acquired the data. EL, LS, SG, BT, KB and CM analysed the data. SG, AB, KC, CF, TH, FL, ALe, IM, DW, EL, LS, SG, BT, KB and CM interpreted the data. All authors contributed to drafting the manuscript. Steve Goodacre is the guarantor of the paper. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. ## Data sharing Anonymised data are available from the corresponding author upon reasonable request (contact details on first page). The Confidentiality Advisory Group of the Health Research Authority will need to consider any requests for data to be used for purposes other than those specified in our application, so a data request should be accompanied by explanation of the purpose of the request and justification of the public benefit. We also recommend inclusion of a pre-specified plan of analysis. ## Role of the funding source The PRIEST study was funded by the United Kingdom National Institute for Health Research Health Technology Assessment (HTA) programme (project reference 11/46/07). The funder played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. View this table: [Supplementary Table S1:](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T5) Supplementary Table S1: Sensitivity and specificity of each threshold of CURB, CRB, PMEWS and NEWS2 for predicting the primary and secondary outcomes ## Acknowledgements We thank Katie Ridsdale for clerical assistance with the study, Erica Wallis (Sponsor representative, all members of the Study Steering Committee (Appendix 2) and the site research teams who delivered the data for the study (Appendix 3), and the research team at the University of Sheffield past and present (Appendix 4). ## Appendix 1: Triage tool scoring details ### CURB-65 and CRB-65 The CURB-65 score uses five parameters, each scoring one point when positive and zero if negative, to give a total score between zero and five. The CRB-65 score does not include urea, so the total score is between zero and four. Five parameters: 1. Confusion: Glasgow Coma Score (GCS) is less than 15 or AVPU is recorded as anything less than alert (A) 2. Urea: Raised blood urea over 7mmol/litre 3. Respiratory: rate of 30 breaths per minute or more 4. Blood pressure: diastolic BP is 60mmHg or less or systolic BP is 90 mmHg or less 5. Age: 65 years or more If data for a parameter was missing, we scored the parameter as zero. ### PMEWS PMEWS uses six physiological and patient parameters to calculate a score from zero to 19. The score is calculated by taking the score in the table below dependent on each of the six physiological parameters then adding points for two patient parameters after if they are positive. Physiological: View this table: [Table6](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T6) Patient: 1. Add 1 point if age>65 2. Add 1 point if either: 1. Patient lives alone / no fixed abode or 2. has a co-morbidity (respiratory, cardiac, renal, immunosuppressed, diabetes) 3. performance status is more than two suggesting limited activity can self-care, limited activity limited self-care, or bed/chair bound no self-care. If data for a parameter was missing, we scored the parameter as zero. If more than three parameters were missing, we did not calculate a score for the patient. If AVPU was missing and GCS was recorded, we imputed the following AVPU scores using GCS: Alert if GCS=15, Verbal response if GCS=12-14; Pain response if GCS=9-11 and Unconscious if GCS<9. ### Swine Flu Adult Hospital Pathway The Swine Flu Adult Hospital Pathway consists of seven criteria operating as a rule, with the rule being positive if any criteria reaches its threshold. View this table: [Table7](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T7) If data for a parameter was missing, we defined the parameter as being negative. If more than three parameters were missing, we did not calculate a score for the patient. ### NEWS2 The NEWS2 has seven parameters, each of which are scores from zero to three providing an overall score between zero and 20. The scores for each parameter can be found in the table below. View this table: [Table8](http://medrxiv.org/content/early/2020/09/07/2020.09.02.20185892/T8) If data for a parameter was missing, we scored the parameter as zero. If more than three parameters were missing, we did not calculate a score for the patient. The scale for patients with confirmed hypercapnic respiratory failure was not used. We analysed NEWS2 in two ways: (1) As a score, with thresholds between zero and 20 on the total score; (2) As a rule, with a single threshold of a total score greater than four or a score of three on any parameter. ### The WHO decision-making algorithm for hospitalisation with pneumonia The WHO decision-making algorithm for hospitalisation with pneumonia recommends admission for an adult patient (rule positive) if any of the following are present: * respiratory rate >30/minute, * oxygen saturation <90%, * respiratory distress, * age >60, * any of the following comorbidities; hypertension, diabetes, cardiovascular disease, chronic respiratory disease, renal impairment immunosuppression If data for a parameter was missing, we assumed it was negative. If more than three parameters were missing, we did not calculate a score for the patient * Received September 2, 2020. * Revision received September 2, 2020. * Accepted September 7, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.NHS. Clinical guide for the management of emergency department patients during the coronavirus pandemic. 17 March 2020 Version 1 [https://www.england.nhs.uk/coronavirus/secondary-care/other-resources/specialtyguides/#ae](https://www.england.nhs.uk/coronavirus/secondary-care/other-resources/specialtyguides/#ae) (accessed 27/08/2020) 2. 2.American College of Emergency Physicians. Guide to Coronavirus Disease (COVID-19) [https://www.acep.org/corona/covid-19-field-guide/cover-page/](https://www.acep.org/corona/covid-19-field-guide/cover-page/) (accessed 27/08/2020) 3. 3.The PRIEST Research Group. Characterisation of 22446 patients attending UK emergency departments with suspected COVID-19 infection: Observational cohort study [Preprint]. medRxiv 2020.08.10.20171496 [https://www.medrxiv.org/content/10.1101/2020.08.10.20171496v1](https://www.medrxiv.org/content/10.1101/2020.08.10.20171496v1) 4. 4.World Health Organisation. Clinical care of severe acute respiratory infections – Tool kit. [https://www.who.int/publications-detail/clinical-care-of-severe-acute-respiratoryinfections-tool-kit](https://www.who.int/publications-detail/clinical-care-of-severe-acute-respiratoryinfections-tool-kit) (accessed 27/08/2020) 5. 5.National Institute for Health and Care Excellence. COVID-19 rapid guideline: managing suspected or confirmed pneumonia in adults in the community. Published: 3 April 2020. [www.nice.org.uk/guidance/ng165](http://www.nice.org.uk/guidance/ng165) (accessed 27/08/2020) 6. 6.Royal College of Physicians. (2017). National Early Warning Score (NEWS) 2: Standardising the assessment of acute-illness severity in the NHS. Updated report of a working party. London: RCP. 7. 7.Lim W, van der Eerden MM, Laing R, Boersma W, Karalus N, Town G, Lewis S, Macfarlane J. Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study. Thorax 2003; 58(5): 377–382. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToidGhvcmF4am5sIjtzOjU6InJlc2lkIjtzOjg6IjU4LzUvMzc3IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDkvMDcvMjAyMC4wOS4wMi4yMDE4NTg5Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 8. 8.Challen K, Bright J, Bentley A, Walter D. Physiological-social score (PMEWS) vs. CURB-65 to triage pandemic influenza: a comparative validation study using community-acquired pneumonia as a proxy. BMC Health Serv Res. 2007; 7: 33. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1472-6963-7-33&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17328822&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F07%2F2020.09.02.20185892.atom) 9. 9.Department of Health. Swine flu clinical package. London: Department of Health; 2009. 10. 10.Public Health England. COVID-19: investigation and initial clinical management of possible cases. [https://www.gov.uk/government/publications/wuhan-novel-coronavirus-initialinvestigation-of-possible-cases/investigation-and-initial-clinical-management-of-possiblecases-of-wuhan-novel-coronavirus-wn-cov-infection#criteria](https://www.gov.uk/government/publications/wuhan-novel-coronavirus-initialinvestigation-of-possible-cases/investigation-and-initial-clinical-management-of-possiblecases-of-wuhan-novel-coronavirus-wn-cov-infection#criteria) (accessed 27/08/2020) 11. 11.Goodacre S, Irving A, Wilson R, Beever D, Challen K. The PAndemic INfluenza Triage in the Emergency Department (PAINTED) pilot cohort study. Health Technol Assess 2015;19(3):170. 12. 12.StataCorp. (2019). Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC. 13. 13.Hirst E, Irving A, Goodacre S. Patient and public involvement in emergency care research. Emerg Med J 2016;33:665–670. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZW1lcm1lZCI7czo1OiJyZXNpZCI7czo4OiIzMy85LzY2NSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzA5LzA3LzIwMjAuMDkuMDIuMjAxODU4OTIuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 14. 14.Goodacre S, Challen K, Wilson R and Campbell M. Evaluation of triage methods used to select patients with suspected pandemic influenza for hospital admission: cohort study. Health Technol Assess 2010;14(46):173–263. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20923612&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F07%2F2020.09.02.20185892.atom) 15. 15.Rowan K, Harrison D et al. “The Swine Flu Triage (SwiFT) study: Development and ongoing refinement of a triage tool to provide regular information to guide immediate policy and practice for the use of critical care services during the H1N1 swine influenza pandemic.” Health Technology Assessment 2010;14(55): 337–496. 16. 16.Muller MP, McGeer AJ, et al. “Evaluation of Pneumonia Severity and Acute Physiology Scores to Predict ICU Admission and Mortality in Patients Hospitalized for Influenza.” PLos One 2010; 5: e9563 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0009563&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20221431&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F07%2F2020.09.02.20185892.atom) 17. 17.Fan G, Tu C, Zhou F, et al. Comparison of severity scores for COVID-19 patients with pneumonia: a retrospective study. Eur Respir J 2020; in press ([https://doi.org/10.1183/13993003.02113-2020](https://doi.org/10.1183/13993003.02113-2020)). 18. 18.Bradley P, Frost F, Tharmaratnam K, Wootton G. The utility of established prognostic scores in COVID-19 hospital admissions: a multicenter prospective evaluation of CURB-65, NEWS2, and qSOFA [Preprint]. medRxiv 2020.07.15.20154815 [https://www.medrxiv.org/content/10.1101/2020.07.15.20154815v2](https://www.medrxiv.org/content/10.1101/2020.07.15.20154815v2) 19. 19.Ma X, Ng M, Xu S et al. Development and validation of prognosis model of mortality risk in patients with COVID-19. Epidemiology and Infection 2020; 148; e168, 1–7. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0950268820001557&link_type=DOI) 20. 20.Satici C, Demirkol MA, Sargin Altunok E, et al. Performance of pneumonia severity index and CURB-65 in predicting 30-day mortality in patients with COVID-19 [published online ahead of print, 2020 Jun 14]. Int J Infect Dis. 2020;98:84–89. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijid.2020.06.038&link_type=DOI) 21. 21.Nguyen Y, Corre F, Honsel V, Curac S, Zarrouk V, Fantin B, Galy A. Applicability of the CURB65 pneumonia severity score for outpatient treatment of COVID-19. Journal of Infection 2020; 81: e96–e98. 22. 22.Gidari A, Vittorio De Socio G, Sabbatini S, Francisci D. Predictive value of National Early Warning Score 2 (NEWS2) for intensive care unit admission in patients with SARS-CoV-2 infection. Infectious Diseases 2020; 52: 698–704. 23. 23.Myrstad M, Ihle-Hansen H, Tveita AA, Andersen EL, Nygård S, Tveit A, Berge T. National Early Warning Score 2 (NEWS2) on admission predicts severe disease and inhospital mortality from Covid-19 – a prospective cohort study. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 2020; 28:66.