Multi-center validation of machine learning model for preoperative prediction of postoperative mortality
Open Access
- 12 July 2022
- journal article
- research article
- Published by Springer Nature in npj Digital Medicine
Abstract
Accurate prediction of postoperative mortality is important for not only successful postoperative patient care but also for information-based shared decision-making with patients and ef fi cient allocation of medical resources. This study aimed to create a machine-learning prediction model for 30-day mortality after a non-cardiac surgery that adapts to the manageable amount of clinical information as input features and is validated against multi-centered rather than single-centered data. Data were collected from 454,404 patients over 18 years of age who underwent non-cardiac surgeries from four independent institutions. We performed a retrospective analysis of the retrieved data. Only 12 – 18 clinical variables were used for model training. Logistic regression, random forest classi fi er, extreme gradient boosting (XGBoost), and deep neural network methods were applied to compare the prediction performances. To reduce over fi tting and create a robust model, bootstrapping and grid search with tenfold cross-validation were performed. The XGBoost method in Seoul National University Hospital (SNUH) data delivers the best performance in terms of the area under receiver operating characteristic curve (AUROC) (0.9376) and the area under the precision- recall curve (0.1593). The predictive performance was the best when the SNUH model was validated with Ewha Womans University Medical Center data (AUROC, 0.941). Preoperative albumin, prothrombin time, and age were the most important features in the model for each hospital. It is possible to create a robust arti fi cial intelligence prediction model applicable to multiple institutions through a light predictive model using only minimal preoperative information that can be automatically extracted from each hospital.Keywords
This publication has 58 references indexed in Scilit:
- Effect of Subjective Preoperative Variables on Risk-Adjusted Assessment of Hospital Morbidity and MortalityAnnals of Surgery, 2009
- Hemostatic Abnormalities and Liver DiseasesSeminars in Thrombosis and Hemostasis, 2008
- The incidence and nature of in-hospital adverse events: a systematic reviewQuality and Safety in Health Care, 2008
- Acute Physiology and Chronic Health Evaluation (APACHE) IV: Hospital mortality assessment for today’s critically ill patients*Critical Care Medicine, 2006
- SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admissionIntensive Care Medicine, 2005
- Comparison of Surgical Risk Score, POSSUM and p-POSSUM in higher-risk surgical patientsBritish Journal of Surgery, 2005
- The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failureIntensive Care Medicine, 1996
- A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter studyJAMA, 1993
- APACHE IICritical Care Medicine, 1985
- APACHE—acute physiology and chronic health evaluation: a physiologically based classification systemCritical Care Medicine, 1981