Machine Learning Models for the Early Real-Time Prediction of Deterioration in Intensive Care Units—A Novel Approach to the Early Identification of High-Risk Patients
Authors:
- Dominik ThieleDTDominik Thiele
- Reitze RodsethRRReitze Rodseth
- Richard FriedlandRFRichard Friedland
- Fabian BergerFBFabian Berger
- Chris MathewCMChris Mathew
- Caroline MasloCMCaroline Maslo
- Vanessa MollVMVanessa Moll
- Christoph LeithnerCLChristoph Leithner
- Christian StormCSChristian Storm
- Alexander KrannichAKAlexander Krannich
- Jens NeeJNJens Nee
Open Access
- 8 January 2025
- journal article
- research article
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 14 (2) , 350
Abstract
Background Predictive machine learning models have made use of a variety of scoring systems to identify clinical deterioration in ICU patients. However, most of these scores include variables that are dependent on medical staff examining the patient. We present the development of a real-time prediction model using clinical variables that are digital and automatically generated for the early detection of patients at risk of deterioration. Methods Routine monitoring data were used in this analysis. ICU patients with at least 24 h of vital sign recordings were included. Deterioration was defined as qSOFA ≥ 2. Model development and validation were performed internally by splitting the cohort into training and test datasets and validating the results on the test dataset. Five different models were trained, tested, and compared against each other. The models were an artificial neural network (ANN), a random forest (RF), a support vector machine (SVM), a linear discriminant analysis (LDA), and a logistic regression (LR). Results In total, 7156 ICU patients were screened for inclusion in the study, which resulted in models trained from a total of 28,348 longitudinal measurements. The artificial neural network showed a superior predictive performance for deterioration, with an area under the curve of 0.81 over 0.78 (RF), 0.78 (SVM), 0.77 (LDA), and 0.76 (LR), by using only four vital parameters. The sensitivity was higher than the specificity for the artificial neural network. Conclusions The artificial neural network, only using four automatically recorded vital signs, was best able to predict deterioration, 10 h before documentation in clinical records. This real-time prediction model has the potential to flag at-risk patients to the healthcare providers treating them, for closer monitoring and further investigation.Keywords
This publication has 39 references indexed in Scilit:
- Queensland Adult Deterioration Detection System observation chart diagnostic accuracy in detecting patient deterioration: A retrospective case–control studyCollegian, 2023
- Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021Intensive Care Medicine, 2021
- Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracyIntensive Care Medicine, 2020
- Digital Transformation: The Smart ICU2020
- Prediction of sepsis patients using machine learning approach: A meta-analysisComputer Methods and Programs in Biomedicine, 2019
- Advancing Continuous Predictive Analytics MonitoringCritical Care Nursing Clinics of North America, 2018
- Piloting electronic medical record–based early detection of inpatient deterioration in community hospitalsJournal of Hospital Medicine, 2016
- A critical analysis of unplanned ICU transfer within 48 hours from ED admission as a quality measureThe American Journal of Emergency Medicine, 2016
- Unplanned transfers to a medical intensive care unit: Causes and relationship to preventable errors in careJournal of Hospital Medicine, 2010
- Duration of life-threatening antecedents prior to intensive care admissionIntensive Care Medicine, 2002