Introducing a machine learning algorithm for delirium prediction—the Supporting SURgery with GEriatric Co-Management and AI project (SURGE-Ahead)
Authors:
- Samuel BenovicSBSamuel Benovic
- Anna H AjlaniAAAnna H Ajlani
- Christoph LeinertCLChristoph Leinert
- Marina FottelerMFMarina Fotteler
- Dennis WolfDWDennis Wolf
- Florian StegerFSFlorian Steger
- Hans KestlerHKHans Kestler
- Dhayana DallmeierDDDhayana Dallmeier
- Michael DenkingerMDMichael Denkinger
- Gerhard W EschweilerGEGerhard W Eschweiler
- Christine ThomasCTChristine Thomas
- Thomas D KocarTKThomas D Kocar
Open Access
- 1 May 2024
- journal article
- research article
- Published by Oxford University Press (OUP) in Age and Ageing
- Vol. 53 (5)
Abstract
Introduction: Post-operative delirium (POD) is a common complication in older patients, with an incidence of 14–56%. To implement preventative procedures, it is necessary to identify patients at risk for POD. In the present study, we aimed to develop a machine learning (ML) model for POD prediction in older patients, in close cooperation with the PAWEL (patient safety, cost-effectiveness and quality of life in elective surgery) project. Methods: The model was trained on the PAWEL study’s dataset of 878 patients (no intervention, age ≥ 70, 209 with POD). Presence of POD was determined by the Confusion Assessment Method and a chart review. We selected 15 features based on domain knowledge, ethical considerations and a recursive feature elimination. A logistic regression and a linear support vector machine (SVM) were trained, and evaluated using receiver operator characteristics (ROC). Results: The selected features were American Society of Anesthesiologists score, multimorbidity, cut-to-suture time, estimated glomerular filtration rate, polypharmacy, use of cardio-pulmonary bypass, the Montreal cognitive assessment subscores ‘memory’, ‘orientation’ and ‘verbal fluency’, pre-existing dementia, clinical frailty scale, age, recent falls, post-operative isolation and pre-operative benzodiazepines. The linear SVM performed best, with an ROC area under the curve of 0.82 [95% CI 0.78–0.85] in the training set, 0.81 [95% CI 0.71–0.88] in the test set and 0.76 [95% CI 0.71–0.79] in a cross-centre validation. Conclusion: We present a clinically useful and explainable ML model for POD prediction. The model will be deployed in the Supporting SURgery with GEriatric Co-Management and AI project.Keywords
Funding Information
- German Federal Ministry of Education and Research (01GY2101)
This publication has 35 references indexed in Scilit:
- Risk factors for delirium in elderly patients after lumbar spinal fusionClinical Neurology and Neurosurgery, 2022
- Outcomes of a Delirium Prevention Program in Older Persons After Elective SurgeryJAMA Surgery, 2021
- Surgical data science – from concepts toward clinical translationMedical Image Analysis, 2021
- Algorithmic injustice: a relational ethics approachPatterns, 2021
- Hospital Elder Life Program: Systematic Review and Meta-analysis of EffectivenessThe American Journal of Geriatric Psychiatry, 2018
- Risk factors for postoperative delirium following hip fracture repair in elderly patients: a systematic review and meta-analysisAging Clinical and Experimental Research, 2016
- Prediction models need appropriate internal, internal–external, and external validationJournal of Clinical Epidemiology, 2016
- The dilemma of delirium: Clinical and research controversies regarding diagnosis and evaluation of delirium in hospitalized elderly medical patientsThe American Journal of Medicine, 1994
- An Introduction to the Bootstrap1993
- A new method of classifying prognostic comorbidity in longitudinal studies: Development and validationJournal of Chronic Diseases, 1987