Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A pragmatic randomized controlled trial of artificial intelligence (AI)-based predictive analytics monitoring for early detection of clinical deterioration

View ORCID ProfileJessica Keim-Malpass, Sarah J Ratcliffe, Matthew T Clark, Katy N Krahn, Oliver J Monfredi, Susan Hamil, Gholamreza Yousevfand, Marieke K Jones, Ashley Nelson, Liza P Moorman, View ORCID ProfileJ. Randall Moorman, Jamieson M Bourque
doi: https://doi.org/10.1101/2025.01.20.25320838
Jessica Keim-Malpass
1Center for Advanced Medical Analytics, School of Medicine, University of Virginia, Charlottesville, VA USA
2Department of Pediatrics, Hematology-Oncology Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jessica Keim-Malpass
  • For correspondence: jlk2t{at}virginia.edu
Sarah J Ratcliffe
3Department of Public Health Sciences, Biostatistics Division, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew T Clark
4Nihon Kohden Digital Health Solutions, Irvine, CA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Katy N Krahn
1Center for Advanced Medical Analytics, School of Medicine, University of Virginia, Charlottesville, VA USA
5Department of Internal Medicine, Cardiovascular Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Oliver J Monfredi
6Department of Internal Medicine, Cardiovascular Division, School of Medicine, Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Susan Hamil
1Center for Advanced Medical Analytics, School of Medicine, University of Virginia, Charlottesville, VA USA
5Department of Internal Medicine, Cardiovascular Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gholamreza Yousevfand
1Center for Advanced Medical Analytics, School of Medicine, University of Virginia, Charlottesville, VA USA
5Department of Internal Medicine, Cardiovascular Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marieke K Jones
3Department of Public Health Sciences, Biostatistics Division, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ashley Nelson
5Department of Internal Medicine, Cardiovascular Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Liza P Moorman
4Nihon Kohden Digital Health Solutions, Irvine, CA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J. Randall Moorman
1Center for Advanced Medical Analytics, School of Medicine, University of Virginia, Charlottesville, VA USA
5Department of Internal Medicine, Cardiovascular Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J. Randall Moorman
Jamieson M Bourque
1Center for Advanced Medical Analytics, School of Medicine, University of Virginia, Charlottesville, VA USA
5Department of Internal Medicine, Cardiovascular Division, School of Medicine, University of Virginia, Charlottesville, VA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background This pragmatic randomized controlled trial aimed to assess the effect of a passive display of artificial intelligence (AI)-based predictive analytics on hours free of clinical deterioration events among medical and surgical patients in an acute care cardiology medical-surgical ward.

Methods 10,422 inpatient visits were randomly assigned by cluster to the intervention group of a display of risk trajectories or to a control group of usual medical care. The trial was undertaken on an 85-bed inpatient cardiology and cardiac surgery ward of an academic hospital with a substantial implementation and education plan. This was a passive display with no specific response mandated. The primary analysis compared events of clinical deterioration (death, emergent ICU transfer, emergent endotracheal intubation, cardiac arrest, or emergent surgery) and compared mortality 21 days after admission.

Results Patients with a large spike in risk score had, on average, twice the length of hospital stay (6.8 compared to 3.4 days). There was no change in the primary outcome between groups. Among those who had a clinical event, there were more event-free hours in the intervention/display-on group compared to the standard-of-care/display-off, but this did not approach statistical significance. 11% of patients were transferred into or out of display beds, a censoring event removing them from the analysis, thereby undermining aspects of the randomized nature of the study.

Conclusion Predictive analytics monitoring incorporating continuous cardiorespiratory monitoring and displays of risk trajectories coupled with an education plan did not improve patient outcomes or reduce deaths. While necessary to conduct the study, the pragmatic design allowed for significant movement towards intervention/displayed beds for sicker patients. Design considerations in the future must focus on understanding clinicians’ interpretation, care processes, and communication practices.

Trial registration NCT04359641

Competing Interest Statement

COI: MC is an employee of Nihon Kohden Digital Health Solutions. LPM and JRM are consultants for Nihon Kohden Digital Health Solutions. JKM owns equity shares of ArteraAI and JRM owns equity shares of Medical Predictive Science Corporation, whose products are not discussed in this unrelated work. The other authors do not express conflicts of interest.

Clinical Trial

NCT04359641

Clinical Protocols

https://pubmed.ncbi.nlm.nih.gov/34043525/

Funding Statement

Funding: This study was funded by the Frederick Thomas Advanced Medical Analytics Fund, University of Virginia and AHRQ R01HS028803 (Keim-Malpass/Bourque MPI). The investigators received in-kind support from Nihon Kohden Digital Health Solutions for use and support of the CoMET system. The funders had no direct role/oversight of this published work.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The Instiutional Review Board of the Unviersity of Virginia gave ethical approval for this work.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • Funding: This study was funded by the Frederick Thomas Advanced Medical Analytics Fund, University of Virginia and AHRQ R01HS028803 (Keim-Malpass/Bourque MPI). The investigators received in-kind support from Nihon Kohden Digital Health Solutions for use and support of the CoMET system. The funders had no direct role/oversight of this published work.

  • COI: MC is an employee of Nihon Kohden Digital Health Solutions. LPM and JRM are consultants for Nihon Kohden Digital Health Solutions. JKM owns equity shares of ArteraAI and JRM owns equity shares of Medical Predictive Science Corporation, whose products are not discussed in this unrelated work. The other authors do not express conflicts of interest.

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted January 22, 2025.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A pragmatic randomized controlled trial of artificial intelligence (AI)-based predictive analytics monitoring for early detection of clinical deterioration
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A pragmatic randomized controlled trial of artificial intelligence (AI)-based predictive analytics monitoring for early detection of clinical deterioration
Jessica Keim-Malpass, Sarah J Ratcliffe, Matthew T Clark, Katy N Krahn, Oliver J Monfredi, Susan Hamil, Gholamreza Yousevfand, Marieke K Jones, Ashley Nelson, Liza P Moorman, J. Randall Moorman, Jamieson M Bourque
medRxiv 2025.01.20.25320838; doi: https://doi.org/10.1101/2025.01.20.25320838
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
A pragmatic randomized controlled trial of artificial intelligence (AI)-based predictive analytics monitoring for early detection of clinical deterioration
Jessica Keim-Malpass, Sarah J Ratcliffe, Matthew T Clark, Katy N Krahn, Oliver J Monfredi, Susan Hamil, Gholamreza Yousevfand, Marieke K Jones, Ashley Nelson, Liza P Moorman, J. Randall Moorman, Jamieson M Bourque
medRxiv 2025.01.20.25320838; doi: https://doi.org/10.1101/2025.01.20.25320838

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Health Informatics
Subject Areas
All Articles
  • Addiction Medicine (576)
  • Allergy and Immunology (868)
  • Anesthesia (306)
  • Cardiovascular Medicine (4483)
  • Dentistry and Oral Medicine (449)
  • Dermatology (385)
  • Emergency Medicine (615)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1528)
  • Epidemiology (15283)
  • Forensic Medicine (31)
  • Gastroenterology (1134)
  • Genetic and Genomic Medicine (6651)
  • Geriatric Medicine (671)
  • Health Economics (1006)
  • Health Informatics (4606)
  • Health Policy (1378)
  • Health Systems and Quality Improvement (1624)
  • Hematology (545)
  • HIV/AIDS (1276)
  • Infectious Diseases (except HIV/AIDS) (15965)
  • Intensive Care and Critical Care Medicine (1111)
  • Medical Education (626)
  • Medical Ethics (147)
  • Nephrology (675)
  • Neurology (6699)
  • Nursing (346)
  • Nutrition (1006)
  • Obstetrics and Gynecology (1153)
  • Occupational and Environmental Health (961)
  • Oncology (3370)
  • Ophthalmology (989)
  • Orthopedics (370)
  • Otolaryngology (421)
  • Pain Medicine (437)
  • Palliative Medicine (131)
  • Pathology (670)
  • Pediatrics (1704)
  • Pharmacology and Therapeutics (700)
  • Primary Care Research (717)
  • Psychiatry and Clinical Psychology (5497)
  • Public and Global Health (9288)
  • Radiology and Imaging (2225)
  • Rehabilitation Medicine and Physical Therapy (1375)
  • Respiratory Medicine (1202)
  • Rheumatology (598)
  • Sexual and Reproductive Health (721)
  • Sports Medicine (536)
  • Surgery (722)
  • Toxicology (100)
  • Transplantation (290)
  • Urology (267)