Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Clinical implementation of a machine learning system to detect deteriorating patients reduces time to response and intervention

View ORCID ProfileSantiago Romero Brufau, View ORCID ProfileJacob Rosenthal, Jordan Kautz, Curtis Storlie, Kim Gaines, Jill Nagel, Adam VanDeusen, Matthew Johnson, Joel Hickman, Dale Hardin, Julie Schmidt, Gene Dankbar, Jeanne Huddleston
doi: https://doi.org/10.1101/2021.10.10.21264823
Santiago Romero Brufau
1Mayo Clinic, Department of Medicine
2Harvard T. H. Chan School of Public Health, Department of Biostatistics
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Santiago Romero Brufau
  • For correspondence: romerobrufau.santiago@mayo.edu
Jacob Rosenthal
3Dana-Farber Cancer Institute, Department of Informatics and Analytics
4Weill Cornell Medicine, Department of Pathology and Laboratory Medicine
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jacob Rosenthal
Jordan Kautz
1Mayo Clinic, Department of Medicine
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Curtis Storlie
5Mayo Clinic, Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kim Gaines
6Mayo Clinic, Department of Nursing
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jill Nagel
1Mayo Clinic, Department of Medicine
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adam VanDeusen
7Indiana University Kelley School of Business, Department of Operations and Decision Technologies
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew Johnson
5Mayo Clinic, Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joel Hickman
5Mayo Clinic, Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dale Hardin
8Mayo Clinic, Management Engineering and Internal Consulting
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Julie Schmidt
6Mayo Clinic, Department of Nursing
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gene Dankbar
8Mayo Clinic, Management Engineering and Internal Consulting
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jeanne Huddleston
1Mayo Clinic, Department of Medicine
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Introduction Acute physiological deterioration is a major contributor to in-hospital morbidity and mortality. Early detection and intervention of deteriorating patients is key to improving patient outcomes. Prior research has demonstrated the effectiveness of Early Warning Systems and other algorithmic approaches in automatically identifying these patients from passively monitoring vital signs.

Methods In this work, we conduct a prospective pilot study of clinical deployment of the Mayo Clinic Bedside Patient Rescue (BPR) system using an escalating alerting logic enabled by machine learning. Among four units where the BPR system was deployed, time to response and time to intervention for deteriorating patients were significantly reduced relative to matched control units.

Results In pilot units, time to response decreased by 35.4% (from 63.2 minutes to 40.8 minutes) and time to intervention decreased by 48.5% (from 106.3 minutes to 55.9 minutes). No significant differences were observed in counterbalance metrics of mortality, ICU transfer rate, and Rapid Response Team activation rate. Furthermore, the automated alerting system was well-received by clinicians participating in the pilot study, as assessed by survey.

Discussion These results demonstrate a successful clinical deployment of a practice-changing machine learning alert system with demonstrable impact on improving patient care.

Competing Interest Statement

The BPR model was licensed by Mayo Clinic to a third-party company; some authors receive royalties as part of the agreement.

Funding Statement

This study did not receive any funding.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The Mayo Clinic Institutional Review Board waived ethical approval for this work.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Data produced in the present study are available upon reasonable request to the authors.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
Back to top
PreviousNext
Posted October 12, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Clinical implementation of a machine learning system to detect deteriorating patients reduces time to response and intervention
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Clinical implementation of a machine learning system to detect deteriorating patients reduces time to response and intervention
Santiago Romero Brufau, Jacob Rosenthal, Jordan Kautz, Curtis Storlie, Kim Gaines, Jill Nagel, Adam VanDeusen, Matthew Johnson, Joel Hickman, Dale Hardin, Julie Schmidt, Gene Dankbar, Jeanne Huddleston
medRxiv 2021.10.10.21264823; doi: https://doi.org/10.1101/2021.10.10.21264823
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Clinical implementation of a machine learning system to detect deteriorating patients reduces time to response and intervention
Santiago Romero Brufau, Jacob Rosenthal, Jordan Kautz, Curtis Storlie, Kim Gaines, Jill Nagel, Adam VanDeusen, Matthew Johnson, Joel Hickman, Dale Hardin, Julie Schmidt, Gene Dankbar, Jeanne Huddleston
medRxiv 2021.10.10.21264823; doi: https://doi.org/10.1101/2021.10.10.21264823

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Health Informatics
Subject Areas
All Articles
  • Addiction Medicine (227)
  • Allergy and Immunology (502)
  • Anesthesia (110)
  • Cardiovascular Medicine (1234)
  • Dentistry and Oral Medicine (206)
  • Dermatology (147)
  • Emergency Medicine (282)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (530)
  • Epidemiology (10015)
  • Forensic Medicine (5)
  • Gastroenterology (499)
  • Genetic and Genomic Medicine (2448)
  • Geriatric Medicine (236)
  • Health Economics (479)
  • Health Informatics (1638)
  • Health Policy (751)
  • Health Systems and Quality Improvement (636)
  • Hematology (248)
  • HIV/AIDS (532)
  • Infectious Diseases (except HIV/AIDS) (11860)
  • Intensive Care and Critical Care Medicine (625)
  • Medical Education (252)
  • Medical Ethics (74)
  • Nephrology (268)
  • Neurology (2277)
  • Nursing (139)
  • Nutrition (350)
  • Obstetrics and Gynecology (453)
  • Occupational and Environmental Health (534)
  • Oncology (1245)
  • Ophthalmology (375)
  • Orthopedics (133)
  • Otolaryngology (226)
  • Pain Medicine (155)
  • Palliative Medicine (50)
  • Pathology (324)
  • Pediatrics (729)
  • Pharmacology and Therapeutics (311)
  • Primary Care Research (282)
  • Psychiatry and Clinical Psychology (2280)
  • Public and Global Health (4829)
  • Radiology and Imaging (834)
  • Rehabilitation Medicine and Physical Therapy (490)
  • Respiratory Medicine (650)
  • Rheumatology (283)
  • Sexual and Reproductive Health (237)
  • Sports Medicine (226)
  • Surgery (266)
  • Toxicology (44)
  • Transplantation (125)
  • Urology (99)