PT  - JOURNAL ARTICLE
AU  - William B. Horton
AU  - Elaine E. Hannah
AU  - Frances L. Morales
AU  - Cherie R. Chaney
AU  - Katy N. Krahn
AU  - Pavel Chernyavskiy
AU  - Matthew T. Clark
AU  - J. Randall Moorman
TI  - Accuracy of a Risk Alert Threshold for ICU Hypoglycemia: Retrospective Analysis of Alert Performance and Association with Clinical Deterioration Events
AID  - 10.1101/2022.06.15.22276435
DP  - 2022 Jan 01
TA  - medRxiv
PG  - 2022.06.15.22276435
4099  - http://medrxiv.org/content/early/2022/06/16/2022.06.15.22276435.short
4100  - http://medrxiv.org/content/early/2022/06/16/2022.06.15.22276435.full
AB  - Objective To quantify the accuracy of and clinical events associated with a risk alert threshold for impending hypoglycemia during ICU admissions.Design Retrospective electronic health record review of clinical events occurring ≥1 and ≤12 hours after the hypoglycemia risk alert threshold was met.Setting Adult ICU admissions from June 2020 through April 2021 at the University of Virginia Medical Center.Patients 342 critically-ill adults that were 63.5% male with median age 60.8 years, median weight 79.1 kg, and median body mass index of 27.5 kg/m2.Interventions Real-world testing of our validated predictive model as a clinical decision support tool for ICU hypoglycemia.Measurements and Main Results We retrospectively reviewed 350 hypothetical alerts that met inclusion criteria for analysis. The alerts correctly predicted 48 cases of Level 1 hypoglycemia that occurred ≥1 and ≤12 hours after the alert threshold was met (positive predictive value= 13.7%). Twenty-one of these 48 cases (43.8%) involved Level 2 hypoglycemia. Notably, three myocardial infarctions, one medical emergency team call, two initiations of cardiopulmonary resuscitation, 6 unplanned surgeries, 19 deaths, 20 arrhythmias, and 38 blood or urine cultures were identified or obtained ≥1 and ≤12 hours after an alert threshold was met. Alerts identified 102 total events of hypoglycemia and/or clinical deterioration, yielding a positive predictive value for any event of 29.1%.Conclusions Alerts generated by a validated ICU hypoglycemia prediction model had positive predictive value of 29.1% for hypoglycemia and other associated adverse clinical events.Question What are the accuracy of and clinical events associated with a risk alert threshold for ICU hypoglycemia?Findings We retrospectively reviewed 350 hypothetical alerts that correctly predicted 48 cases of Level 1 hypoglycemia occurring ≥1 and ≤12 hours after the alert threshold was met (positive predictive value= 13.7%). Notably, three myocardial infarctions, one medical emergency team call, two initiations of cardiopulmonary resuscitation, 6 unplanned surgeries, 19 deaths, 20 arrhythmias, and 38 blood or urine cultures were identified or obtained ≥1 and ≤12 hours after an alert threshold was met.Meaning Alerts generated by a validated ICU hypoglycemia prediction model had positive predictive value of 29.1% for hypoglycemia and other associated adverse clinical events.Competing Interest StatementWBH, EEH, FLM, CRC, KNK, and PC have no conflicts of interests to disclose. MTC is employed as Principal Software Engineer of Nihon Kohden Digital Health Solutions, Inc. JRM is a consultant for Nihon Kohden Digital Health Solutions, Inc., with proceeds donated to the University of Virginia. This work was supported by the University of Virginia Launchpad for Diabetes Program and the Frederick Thomas Advanced Medical Analytics Fund.Funding StatementThis work was supported by the University of Virginia Launchpad for Diabetes Program and the Frederick Thomas Advanced Medical Analytics Fund.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study (Chart Review for Predictive Modeling in the Hospital; IRB #22152), was reviewed by the UVA IRB for Health Sciences Research and the need for IRB approval and informed consent was waived on 08/07/2020.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors