PT  - JOURNAL ARTICLE
AU  - Giesa, Niklas
AU  - Haufe, Stefan
AU  - Menk, Mario
AU  - Weiß, Björn
AU  - Spies, Claudia
AU  - Piper, Sophie K.
AU  - Balzer, Felix
AU  - Boie, Sebastian D.
TI  - Predicting postoperative delirium assessed by the Nursing Screening Delirium Scale in the recovery room for non-cardiac surgeries without craniotomy: A retrospective study using a machine learning approach
AID  - 10.1101/2023.11.21.23298802
DP  - 2023 Jan 01
TA  - medRxiv
PG  - 2023.11.21.23298802
4099  - http://medrxiv.org/content/early/2023/11/27/2023.11.21.23298802.short
4100  - http://medrxiv.org/content/early/2023/11/27/2023.11.21.23298802.full
AB  - Background Postoperative delirium (POD) contributes to severe outcomes such as death or development of dementia. Thus, it is desirable to identify vulnerable patients in advance during the perioperative phase. Previous studies mainly investigated risk factors for delirium during hospitalization and further used a linear logistic regression (LR) approach with time-invariant data. Studies have not investigated patients’ fluctuating conditions to support POD precautions.Objective In this single-center study, we aimed to predict POD in a recovery room setting with a non-linear machine learning (ML) technique using pre-, intra-, and postoperative data.Methods The target variable POD was defined with the Nursing Screening Delirium Scale (Nu-DESC) ≥ 1. Feature selection was conducted based on robust univariate test statistics and L1 regularization. Non-linear multi-layer perceptron (MLP) as well as tree-based models were trained and evaluated – with the receiver operating characteristics curve (AUROC), the area under precision recall curve (AUPRC), and additional metrics – against LR and published models on bootstrapped testing data.Results The prevalence of POD was 8.2% in a sample of 73,181 surgeries performed between 2017 and 2020. Significant univariate impact factors were the preoperative ASA status, the intraoperative amount of given remifentanil, and the postoperative Aldrete score. The best model used pre-, intra-, and postoperative data. The tree-based model achieved a mean AUROC of 0.854 and a mean AUPRC of 0.418 outperforming linear LR, well as best applied and retrained baseline models.Conclusions Overall, non-linear machine learning models using data from multiple perioperative time phases were superior to traditional ones in predicting POD in the recovery room. Class imbalance was seen as a main impediment for model application in clinical practice.Author Summary Currently, the pathophysiology of postoperative delirium (POD) is unknown. Hence, there is no dedicated medication for treatment. Patients who experience POD are oftentimes mentally disturbed causing pressure on related family members, clinicians, and the health system. With our study, we want to detect POD before onset trying to give decision support to health professionals. Vulnerable patients could be transferred to delirium wards mitigating the risk of severe outcomes such as permanent cognitive decline. We also provide insides into clinical parameters - recorded before, during, and after the surgery - that could be adapted for reducing POD risk. Our work is openly available, developed for clinical implementation, and could be transferred to other clinical institutions.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe author(s) received no specific funding for this work.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was performed under ethics approval granted by the independent ethics committee at Charité – Universitätsmedizin Berlin (vote EA4/254/21).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesDue to German data protection and privacy laws, we can not provide the original data. We furthermore add comprehensive summary statistics to describe our raw data. https://github.com/ngiesa/icdep AUCArea under the curveBPBlood pressureCAMConfusion Assessment MethodCIConfidence IntervalCRPC-reactive proteinCVCross validationEHRElectronic health recordsESAEuropean Society of AnaesthesiologyICUIntensive Care UnitIQCODEInformant Questionnaire on Cognitive Decline in the ElderlyLIMELocal interpretable model-agnostic explanationsLRLogistic regressionMADMedian absolute deviationMLPMulti-layer perceptronMMSEMini-Mental State ExaminationMWUMann-Whitney UNu-DESCNursing Screening Delirium ScaleOROdds ratioPCVPressure Control VentilationSEFSpectral edge frequencySHAPEShapley Additive exPlanations