Abstract
Frequent assessment of the severity of illness for hospitalized patients is essential in clinical settings to prevent outcomes such as in-hospital mortality and unplanned ICU admission. Classical severity scores have been developed typically using relatively few patient features, especially for intensive care. Recently, deep learning-based models demonstrated better individualized risk assessments compared to classic risk scores such as SOFA and NEWS, thanks to the use of aggregated and more heterogeneous data sources for dynamic risk prediction. We investigated to what extent deep learning methods can capture patterns of longitudinal change in health status using time-stamped data from electronic health records. We used medical history data, biochemical measurements, and the clinical notes from all patients admitted to non-intensive care units in 12 hospitals in Denmark’s Capital Region and Region Zealand during 2011-2016. Data from a total of 852,620 patients and 2,241,849 admissions were used to predict the composite outcome of unplanned ICU transfer and in-hospital death at different time points after admission to general departments. We subsequently examined feature interpretations of the models. The best model used all data modalities with an assessment rate of 6 hours and a prediction window of 14 days, with an AUPRC of 0.287 and AUROC of 0.898. These performances are comparable to the current state of the art and make the model suitable for further prospective validation as a risk assessment tool in a clinical setting.
Competing Interest Statement
S.B. has ownership in Intomics A/S, Hoba Therapeutics Aps, Novo Nordisk A/S, Lundbeck A/S and managing board memberships in Proscion A/S and Intomics A/S.
Funding Statement
The Novo Nordisk Foundation (grants NNF17OC0027594 and NNF14CC0001) and the Danish Innovation Found (5184-00102B) supported this study.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by the Danish Patient Safety Authority (3-3013-1731 and 3– 3013–1723), the Danish Data Protection Agency (DT SUND 2016–48, 2016–50, 2017–57 and UCPH 514-0255/18-3000:) and the Danish Health Data Authority (FSEID 00003092, FSEID 00003724, FSEID 00004758 and FSEID 00005191)
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
The authors do not have permission to share data access to the original data can be obtained from the Danish health authorities.