Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit
Authors:
Open Access
- 8 November 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-12
Abstract
Given the limited capacity to accurately determine the necessity for intubation in intensive care unit settings, this study aimed to develop and externally validate an interpretable machine learning model capable of predicting the need for intubation among ICU patients. Seven widely used machine learning (ML) algorithms were employed to construct the prediction models. Adult patients from the Medical Information Mart for Intensive Care IV database who stayed in the ICU for longer than 24 h were included in the development and internal validation. The model was subsequently externally validated using the eICU-CRD database. In addition, the SHapley Additive exPlanations method was employed to interpret the influence of individual parameters on the predictions made by the model. A total of 11,988 patients were included in the final cohort for this study. The CatBoost model demonstrated the best performance (AUC: 0.881). In the external validation set, the efficacy of our model was also confirmed (AUC: 0.750), which suggests robust generalization capabilities. The Glasgow Coma Scale (GCS), body mass index (BMI), arterial partial pressure of oxygen (PaO2), respiratory rate (RR) and length of stay (LOS) before ICU were the top 5 features of the CatBoost model with the greatest impact. We developed an externally validated CatBoost model that accurately predicts the need for intubation in ICU patients within 24 to 96 h of admission, facilitating clinical decision-making and has the potential to improve patient outcomes. The prediction model utilizes readily obtainable monitoring parameters and integrates the SHAP method to enhance interpretability, providing clinicians with clear insights into the factors influencing predictions.Keywords
All Related Versions
Funding Information
- Chongqing Medical University (CYS21248)
- Chongqing Municipal Public Health Bureau, Chongqing People’s Municipal Government (2022MSXM006)
- Natural Science Foundation of Chongqing Municipality (cstc2020jcyj-msxmX0254)
This publication has 47 references indexed in Scilit:
- Predicting time-to-intubation after critical care admission using machine learning and cured fraction informationArtificial Intelligence in Medicine, 2024
- Prevalence of peri-intubation major adverse events among critically ill patients: A systematic review and meta analysisThe American Journal of Emergency Medicine, 2023
- A comparison of machine learning algorithms in predicting COVID-19 prognosticsInternal and Emergency Medicine, 2022
- Interpretable Machine Learning for Early Prediction of Prognosis in Sepsis: A Discovery and Validation StudyInfectious Diseases and Therapy, 2022
- Prediction of weaning from mechanical ventilation using Convolutional Neural NetworksArtificial Intelligence in Medicine, 2021
- Intubation Practices and Adverse Peri-intubation Events in Critically Ill Patients From 29 CountriesJAMA, 2021
- A prospective, observational, cohort study of airway management of patients with COVID-19 by specialist tracheal intubation teamsCanadian Journal of Anesthesia/Journal canadien d'anesthésie, 2020
- Effect of a Low vs Intermediate Tidal Volume Strategy on Ventilator-Free Days in Intensive Care Unit Patients Without ARDSJAMA, 2018
- Machine-Learning-Based Electronic Triage More Accurately Differentiates Patients With Respect to Clinical Outcomes Compared With the Emergency Severity IndexAnnals of Emergency Medicine, 2018
- An intervention to decrease complications related to endotracheal intubation in the intensive care unit: a prospective, multiple-center studyIntensive Care Medicine, 2009