Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Accuracy of telephone triage for predicting adverse outcome in suspected COVID-19: An observational cohort study

View ORCID ProfileCarl Marincowitz, View ORCID ProfileTony Stone, View ORCID ProfilePeter Bath, Richard Campbell, View ORCID ProfileJanette Turner, Madina Hussein, View ORCID ProfileRichard Pilbery, View ORCID ProfileBenjamin Thomas, View ORCID ProfileLaura Sutton, View ORCID ProfileFiona Bell, View ORCID ProfileKatie Biggs, View ORCID ProfileFrank Hopfgartner, View ORCID ProfileSuvodeep Mazumdar, View ORCID ProfileJennifer Petrie, Steve Goodacre
doi: https://doi.org/10.1101/2021.06.24.21259441
Carl Marincowitz
1Centre for Urgent and Emergency Care Research (CURE), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345, Email:
Roles: NIHR Clinical Lecturer Emergency Medicine
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Carl Marincowitz
  • For correspondence: C.Marincowitz@Sheffield.ac.uk
Tony Stone
1Centre for Urgent and Emergency Care Research (CURE), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345, Email:
Roles: Senior Data Manager
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tony Stone
  • For correspondence: C.Marincowitz@Sheffield.ac.uk
Peter Bath
2Information School, University of Sheffield, Regent Court, 211 Portobello St, Sheffield S1 4DP, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Peter Bath
Richard Campbell
1Centre for Urgent and Emergency Care Research (CURE), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345, Email:
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: C.Marincowitz@Sheffield.ac.uk
Janette Turner
1Centre for Urgent and Emergency Care Research (CURE), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345, Email:
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Janette Turner
  • For correspondence: C.Marincowitz@Sheffield.ac.uk
Madina Hussein
2Information School, University of Sheffield, Regent Court, 211 Portobello St, Sheffield S1 4DP, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard Pilbery
3Yorkshire Ambulance Service NHS Trust, Trust HQ, Springhill 2, Brindley Way, Wakefield, United Kingdom, WF2 0XQ
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Richard Pilbery
Benjamin Thomas
4Clinical Trials Research Unit (CTRU), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benjamin Thomas
  • For correspondence: b.d.thomas@sheffield.ac.uk
Laura Sutton
4Clinical Trials Research Unit (CTRU), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Laura Sutton
Fiona Bell
3Yorkshire Ambulance Service NHS Trust, Trust HQ, Springhill 2, Brindley Way, Wakefield, United Kingdom, WF2 0XQ
Roles: Head of Research
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Fiona Bell
Katie Biggs
4Clinical Trials Research Unit (CTRU), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Katie Biggs
Frank Hopfgartner
2Information School, University of Sheffield, Regent Court, 211 Portobello St, Sheffield S1 4DP, UK
Roles: Senior Lecturer in Data Science
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Frank Hopfgartner
Suvodeep Mazumdar
2Information School, University of Sheffield, Regent Court, 211 Portobello St, Sheffield S1 4DP, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Suvodeep Mazumdar
Jennifer Petrie
4Clinical Trials Research Unit (CTRU), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jennifer Petrie
Steve Goodacre
1Centre for Urgent and Emergency Care Research (CURE), Health Services Research School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK, Fax: +44 (0)114 222 0749 Tel: (+44) (0)114 222 4345, Email:
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: C.Marincowitz@Sheffield.ac.uk
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Objective To assess accuracy of telephone triage in identifying patients who need emergency care amongst those with suspected COVID-19 infection and identify factors which affect triage accuracy.

Design Observational cohort study

Setting Community telephone triage in the Yorkshire and Humber, Bassetlaw, North Lincolnshire and North East Lincolnshire region.

Participants 40, 261 adults who contacted NHS 111 telephone triage services provided by Yorkshire Ambulance Service NHS Trust between the 18th March 2020 and 29th June 2020 with symptoms indicating possible COVID-19 infection were linked to Office for National Statistics death registration data, hospital and general practice electronic health care data collected by NHS Digital.

Outcome Accuracy of triage disposition (self-care/non-urgent clinical assessment versus ambulance dispatch/urgent clinical assessment) was assessed in terms of death or need for organ support at 30, 7 and 3 days from first contact with the telephone triage service.

Results Callers had a 3% (1, 200/40, 261) risk of adverse outcome. Telephone triage recommended self-care or non-urgent assessment for 60% (24, 335/40, 261), with a 1.3% (310/24, 335) risk of subsequent adverse outcome. Telephone triage had 74.2% sensitivity (95% CI: 71.6 to 76.6%) and 61.5% specificity (61% to 62%) for adverse outcomes at 30 days from first contact. Multivariable analysis suggested some co-morbidities (such as chronic respiratory disease) may be over-estimated as predictors of adverse outcome, while the association of diabetes with adverse outcome may be under-estimated. Repeat contact with the service appears to be an important under recognised predictor of adverse outcomes with both 2 contacts (OR 1.77 95% CI: 1.14 to 2.75) and 3 or more contacts (OR 4.02 95% CI: 1.68 to 9.65) associated with clinical deterioration when not provided with an ambulance or urgent clinical assessment.

Conclusion Patients advised to self-care or receive non-urgent clinical assessment had a small but non-negligible risk of serious clinical deterioration. The sensitivity and specificity of telephone triage was comparable to other tools used to triage patient acuity in emergency and urgent care. Repeat contact with telephone services needs recognition as an important predictor of subsequent adverse outcomes.

What is already known on this topic

  • Telephone triage has been used to divert patients with suspected COVID-19 to self care or for non-urgent clinical assessments, and thereby help mitigate the risk of health services being overwhelmed by patients who require no speficic treatment.

  • Concerns have been raised that telephone triage may not be sufficiently accurate in identifying need for emergency care. However, no previous evaluation of accuracy of telephone triage in patients with suspected COVID-19 infection has been completed.

What this study adds

  • Patients advised to self care or receive non-urgent clinical assessment had a small but non-negligible risk of deterioration and significant adverse outcomes.

  • Telephone triage has comparable performance to methods used to triage patient acuity in other emergency and urgent care settings.

  • Accuracy of triage may be improved by better recognition of multiple contact with services as a predictor of adverse outcomes.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Trial

https://www.isrctn.com/ISRCTN28342533

Funding Statement

The PRIEST study was funded by the United Kingdom National Institute for Health Research Health Technology Assessment (HTA) programme (project reference 11/46/07). The funder played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The North West - Haydock Research Ethics Committee gave a favourable opinion on the PAINTED study on 25 June 2012 (reference 12/NW/0303) and on the updated PRIEST study on 23rd March 2020. The Confidentiality Advisory Group of the Health Research Authority granted approval to collect data without patient consent in line with Section 251 of the National Health Service Act 2006.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Primary data from this study is not available for sharing from the study team. Data contained from this article is attenable from NHS digital and Yorkshire Ambulance service, following their procedures.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted June 29, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Accuracy of telephone triage for predicting adverse outcome in suspected COVID-19: An observational cohort study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Accuracy of telephone triage for predicting adverse outcome in suspected COVID-19: An observational cohort study
Carl Marincowitz, Tony Stone, Peter Bath, Richard Campbell, Janette Turner, Madina Hussein, Richard Pilbery, Benjamin Thomas, Laura Sutton, Fiona Bell, Katie Biggs, Frank Hopfgartner, Suvodeep Mazumdar, Jennifer Petrie, Steve Goodacre
medRxiv 2021.06.24.21259441; doi: https://doi.org/10.1101/2021.06.24.21259441
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Accuracy of telephone triage for predicting adverse outcome in suspected COVID-19: An observational cohort study
Carl Marincowitz, Tony Stone, Peter Bath, Richard Campbell, Janette Turner, Madina Hussein, Richard Pilbery, Benjamin Thomas, Laura Sutton, Fiona Bell, Katie Biggs, Frank Hopfgartner, Suvodeep Mazumdar, Jennifer Petrie, Steve Goodacre
medRxiv 2021.06.24.21259441; doi: https://doi.org/10.1101/2021.06.24.21259441

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Emergency Medicine
Subject Areas
All Articles
  • Addiction Medicine (228)
  • Allergy and Immunology (506)
  • Anesthesia (110)
  • Cardiovascular Medicine (1245)
  • Dentistry and Oral Medicine (206)
  • Dermatology (147)
  • Emergency Medicine (282)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (534)
  • Epidemiology (10032)
  • Forensic Medicine (5)
  • Gastroenterology (500)
  • Genetic and Genomic Medicine (2466)
  • Geriatric Medicine (238)
  • Health Economics (480)
  • Health Informatics (1647)
  • Health Policy (754)
  • Health Systems and Quality Improvement (637)
  • Hematology (250)
  • HIV/AIDS (536)
  • Infectious Diseases (except HIV/AIDS) (11872)
  • Intensive Care and Critical Care Medicine (626)
  • Medical Education (253)
  • Medical Ethics (75)
  • Nephrology (268)
  • Neurology (2290)
  • Nursing (139)
  • Nutrition (352)
  • Obstetrics and Gynecology (454)
  • Occupational and Environmental Health (537)
  • Oncology (1249)
  • Ophthalmology (377)
  • Orthopedics (134)
  • Otolaryngology (226)
  • Pain Medicine (158)
  • Palliative Medicine (50)
  • Pathology (325)
  • Pediatrics (734)
  • Pharmacology and Therapeutics (315)
  • Primary Care Research (282)
  • Psychiatry and Clinical Psychology (2281)
  • Public and Global Health (4844)
  • Radiology and Imaging (843)
  • Rehabilitation Medicine and Physical Therapy (492)
  • Respiratory Medicine (652)
  • Rheumatology (286)
  • Sexual and Reproductive Health (241)
  • Sports Medicine (227)
  • Surgery (269)
  • Toxicology (44)
  • Transplantation (125)
  • Urology (99)