Early prediction of MODS interventions in the intensive care unit using machine learning
Open Access
- 4 May 2023
- journal article
- research article
- Published by Springer Nature in Journal of Big Data
- Vol. 10 (1) , 1-18
Abstract
Background: Multiple organ dysfunction syndrome (MODS) is one of the leading causes of death in critically ill patients. MODS is the result of a dysregulated inflammatory response that can be triggered by various causes. Owing to the lack of an effective treatment for patients with MODS, early identification and intervention are the most effective strategies. Therefore, we have developed a variety of early warning models whose prediction results can be interpreted by Kernel SHapley Additive exPlanations (Kernel-SHAP) and reversed by diverse counterfactual explanations (DiCE). So we can predict the probability of MODS 12 h in advance, quantify the risk factors, and automatically recommend relevant interventions. Methods: We used various machine learning algorithms to complete the early risk assessment of MODS, and used a stacked ensemble to improve the prediction performance. The kernel-SHAP algorithm was used to quantify the positive and minus factors corresponding to the individual prediction results, and finally, the DiCE method was used to automatically recommend interventions. We completed the model training and testing based on the MIMIC-III and MIMIC-IV databases, in which the sample features in the model training included the patients’ vital signs, laboratory test results, test reports, and data related to the use of ventilators. Results: The customizable model called SuperLearner, which integrated multiple machine learning algorithms, had the highest authenticity of screening, and its Yordon index (YI), sensitivity, accuracy, and utility_score on the MIMIC-IV test set were 0.813, 0.884, 0.893, and 0.763, respectively, which were all maximum values of eleven models. The area under the curve of the deep–wide neural network (DWNN) model on the MIMIC-IV test set was 0.960, and the specificity was 0.935, which were both the maximum values of all these models. The Kernel-SHAP algorithm combined with SuperLearner was used to determine the minimum value of glasgow coma scale (GCS) in the current hour (OR = 0.609, 95% CI 0.606–0.612), maximum value of MODS score corresponding to GCS in the past 24 h (OR = 2.632, 95% CI 2.588–2.676), and maximum score of MODS corresponding to creatinine in the past 24 h (OR = 3.281, 95% CI 3.267–3.295) were generally the most influential factors. Conclusion: The MODS early warning model based on machine learning algorithms has considerable application value, and the prediction efficiency of SuperLearner is superior to those of SubSuperLearner, DWNN, and other eight common machine learning models. Considering that the attribution analysis of Kernel-SHAP is a static analysis of the prediction results, we introduce the DiCE algorithm to automatically recommend counterfactuals to reverse the prediction results, which will be an important step towards the practical application of automatic MODS early intervention.Keywords
Funding Information
- China PLA Scientific Key Grant (20-163-12-ZT-005-003-01)
- China Key Scientific Grant Program (No. 2021YFC0122500)
- National Science Foundation for Young Scientists of China (Grant No. 82100096)
- National Science Foundation for Young Scientists of Beijing (Grant No. 7214254)
This publication has 28 references indexed in Scilit:
- Incidence and Prognostic Value of the Systemic Inflammatory Response Syndrome and Organ Dysfunctions in Ward PatientsAmerican Journal of Respiratory and Critical Care Medicine, 2015
- The pediatric multiple organ dysfunction syndromePediatric Critical Care Medicine, 2009
- Causes of death and determinants of outcome in critically ill patientsCritical Care, 2006
- Incidence and Impact of Organ Dysfunctions Associated With SepsisChest, 2005
- International pediatric sepsis consensus conference: Definitions for sepsis and organ dysfunction in pediatrics*Pediatric Critical Care Medicine, 2005
- Multiple organ dysfunction: Baseline and serial component scoresCritical Care Medicine, 2001
- Epidemiology of severe sepsis in the United States: Analysis of incidence, outcome, and associated costs of careCritical Care Medicine, 2001
- Efficacy and Safety of Recombinant Human Activated Protein C for Severe SepsisNew England Journal of Medicine, 2001
- Epidemiology of Multiple Organ Dysfunction Syndrome in Critical Surgical IllnessSurgical Infections, 2000
- Epidemiology of Sepsis and Multiple Organ Dysfunction Syndrome in ChildrenChest, 1996