Predicting Mortality Using Machine Learning Algorithms in Patients Who Require Renal Replacement Therapy in the Critical Care Unit
Authors:
- Hsin-Hsiung ChangHCHsin-Hsiung Chang
- Jung-Hsien ChiangJCJung-Hsien Chiang
- Chi-Shiang WangCWChi-Shiang Wang
- Ping-Fang ChiuPCPing-Fang Chiu
- Khaled Abdel-KaderKAKhaled Abdel-Kader
- Huiwen ChenHCHuiwen Chen
- Edward D. SiewESEdward D. Siew
- Jonathan YabesJYJonathan Yabes
- Raghavan MuruganRMRaghavan Murugan
- Gilles ClermontGCGilles Clermont
- Paul M. PalevskyPPPaul M. Palevsky
- Manisha JhambMJManisha Jhamb
Open Access
- 8 September 2022
- journal article
- research article
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 11 (18) , 5289
Abstract
Background: General severity of illness scores are not well calibrated to predict mortality among patients receiving renal replacement therapy (RRT) for acute kidney injury (AKI). We developed machine learning models to make mortality prediction and compared their performance to that of the Sequential Organ Failure Assessment (SOFA) and HEpatic failure, LactatE, NorepInephrine, medical Condition, and Creatinine (HELENICC) scores. Methods: We extracted routinely collected clinical data for AKI patients requiring RRT in the MIMIC and eICU databases. The development models were trained in 80% of the pooled dataset and tested in the rest of the pooled dataset. We compared the area under the receiver operating characteristic curves (AUCs) of four machine learning models (multilayer perceptron [MLP], logistic regression, XGBoost, and random forest [RF]) to that of the SOFA, nonrenal SOFA, and HELENICC scores and assessed calibration, sensitivity, specificity, positive (PPV) and negative (NPV) predicted values, and accuracy. Results: The mortality AUC of machine learning models was highest for XGBoost (0.823; 95% confidence interval [CI], 0.791–0.854) in the testing dataset, and it had the highest accuracy (0.758). The XGBoost model showed no evidence of lack of fit with the Hosmer–Lemeshow test (p > 0.05). Conclusion: XGBoost provided the highest performance of mortality prediction for patients with AKI requiring RRT compared with previous scoring systems.Keywords
Funding Information
- Ministry of Science and Technology Research (109-2634-F-006-016)
- Vanderbilt O’Brien Kidney Center P30-DK114809 Clinical and Translational Core (109-2634-F-006-016)
This publication has 32 references indexed in Scilit:
- Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and ElaborationAnnals of Internal Medicine, 2015
- Evaluation of simplified acute physiology score 3 performance: a systematic review of external validation studiesCritical Care, 2014
- Model to Predict Mortality in Critically Ill Adults with Acute Kidney InjuryClinical Journal of the American Society of Nephrology, 2011
- SAPS 3 scores at the start of renal replacement therapy predict mortality in critically ill patients with acute kidney injuryKidney International, 2010
- Nonrecovery of Kidney Function and Death after Acute on Chronic Renal FailureClinical Journal of the American Society of Nephrology, 2009
- Acute Physiology and Chronic Health Evaluation (APACHE) IV: Hospital mortality assessment for today’s critically ill patients*Critical Care Medicine, 2006
- SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admissionIntensive Care Medicine, 2005
- Acute Renal Failure in Critically Ill PatientsA Multinational, Multicenter StudyJAMA, 2005
- A Clinical Score to Predict Acute Renal Failure after Cardiac SurgeryJournal of the American Society of Nephrology, 2005
- The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failureIntensive Care Medicine, 1996