Abstract
Background Postoperative delirium (POD) contributes to severe outcomes such as death or development of dementia. Thus, it is desirable to identify vulnerable patients in advance during the perioperative phase. Previous studies mainly investigated risk factors for delirium during hospitalization and further used a linear logistic regression (LR) approach with time-invariant data. Studies have not investigated patients’ fluctuating conditions to support POD precautions.
Objective In this single-center study, we aimed to predict POD in a recovery room setting with a non-linear machine learning (ML) technique using pre-, intra-, and postoperative data.
Methods The target variable POD was defined with the Nursing Screening Delirium Scale (Nu-DESC) ≥ 1. Feature selection was conducted based on robust univariate test statistics and L1 regularization. Non-linear multi-layer perceptron (MLP) as well as tree-based models were trained and evaluated – with the receiver operating characteristics curve (AUROC), the area under precision recall curve (AUPRC), and additional metrics – against LR and published models on bootstrapped testing data.
Results The prevalence of POD was 8.2% in a sample of 73,181 surgeries performed between 2017 and 2020. Significant univariate impact factors were the preoperative ASA status, the intraoperative amount of given remifentanil, and the postoperative Aldrete score. The best model used pre-, intra-, and postoperative data. The tree-based model achieved a mean AUROC of 0.854 and a mean AUPRC of 0.418 outperforming linear LR, well as best applied and retrained baseline models.
Conclusions Overall, non-linear machine learning models using data from multiple perioperative time phases were superior to traditional ones in predicting POD in the recovery room. Class imbalance was seen as a main impediment for model application in clinical practice.
Author Summary Currently, the pathophysiology of postoperative delirium (POD) is unknown. Hence, there is no dedicated medication for treatment. Patients who experience POD are oftentimes mentally disturbed causing pressure on related family members, clinicians, and the health system. With our study, we want to detect POD before onset trying to give decision support to health professionals. Vulnerable patients could be transferred to delirium wards mitigating the risk of severe outcomes such as permanent cognitive decline. We also provide insides into clinical parameters - recorded before, during, and after the surgery - that could be adapted for reducing POD risk. Our work is openly available, developed for clinical implementation, and could be transferred to other clinical institutions.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
The author(s) received no specific funding for this work.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was performed under ethics approval granted by the independent ethics committee at Charité – Universitätsmedizin Berlin (vote EA4/254/21).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
Due to German data protection and privacy laws, we can not provide the original data. We furthermore add comprehensive summary statistics to describe our raw data.
Abbreviations
- AUC
- Area under the curve
- BP
- Blood pressure
- CAM
- Confusion Assessment Method
- CI
- Confidence Interval
- CRP
- C-reactive protein
- CV
- Cross validation
- EHR
- Electronic health records
- ESA
- European Society of Anaesthesiology
- ICU
- Intensive Care Unit
- IQCODE
- Informant Questionnaire on Cognitive Decline in the Elderly
- LIME
- Local interpretable model-agnostic explanations
- LR
- Logistic regression
- MAD
- Median absolute deviation
- MLP
- Multi-layer perceptron
- MMSE
- Mini-Mental State Examination
- MWU
- Mann-Whitney U
- Nu-DESC
- Nursing Screening Delirium Scale
- OR
- Odds ratio
- PCV
- Pressure Control Ventilation
- SEF
- Spectral edge frequency
- SHAPE
- Shapley Additive exPlanations