Machine Learning–Based Prediction of Early Complications Following Surgery for Intestinal Obstruction: Multicenter Retrospective Study (Preprint)
Preprint
- 4 November 2024
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Early complications increase in-hospital stay and mortality after intestinal obstruction surgery. It is important to identify the risk of postoperative early complications for patients with intestinal obstruction at a sufficiently early stage, which would allow preemptive individualized enhanced therapy to be conducted to improve the prognosis of patients with intestinal obstruction. A risk predictive model based on machine learning is helpful for early diagnosis and timely intervention. OBJECTIVE This study aimed to construct an online risk calculator for early postoperative complications in patients after intestinal obstruction surgery based on machine learning algorithms. METHODS A total of 396 patients undergoing intestinal obstruction surgery from April 2013 to April 2021 at an independent medical center were enrolled as the training cohort. Overall, 7 machine learning methods were used to establish prediction models, with their performance appraised via the area under the receiver operating characteristic curve (AUROC), accuracy, sensitivity, specificity, and F1-score. The best model was validated through 2 independent medical centers, a publicly available perioperative dataset the Informative Surgical Patient dataset for Innovative Research Environment (INSPIRE), and a mixed cohort consisting of the above 3 datasets, involving 50, 66, 48, and 164 cases, respectively. Shapley Additive Explanations were measured to identify risk factors. RESULTS The incidence of postoperative complications in the training cohort was 47.44% (176/371), while the incidences in 4 external validation cohorts were 34% (17/50), 56.06% (37/66), 52.08% (25/48), and 48.17% (79/164), respectively. Postoperative complications were associated with 8-item features: Physiological Severity Score for the Enumeration of Mortality and Morbidity (POSSUM physiological score), the amount of colloid infusion, shock index before anesthesia induction, ASA (American Society of Anesthesiologists) classification, the percentage of neutrophils, shock index at the end of surgery, age, and total protein. The random forest model showed the best overall performance, with an AUROC of 0.788 (95% CI 0.709-0.869), accuracy of 0.756, sensitivity of 0.695, specificity of 0.810, and F1-score of 0.727 in the training cohort. The random forest model also achieved a comparable AUROC of 0.755 (95% CI 0.652-0.839) in validation cohort 1, a greater AUROC of 0.817 (95% CI 0.695-0.913) in validation cohort 2, a similar AUROC of 0.786 (95% CI 0.628-0.902) in validation cohort 3, and the comparable AUROC of 0.720 (95% CI 0.671-0.768) in validation cohort 4. We visualized the random forest model and created a web-based online risk calculator. CONCLUSIONS We have developed and validated a generalizable random forest model to predict postoperative early complications in patients undergoing intestinal obstruction surgery, enabling clinicians to screen high-risk patients and implement early individualized interventions. An online risk calculator for early postoperative complications was developed to make the random forest model accessible to clinicians around the world. CLINICALTRIALKeywords
All Related Versions
- Published version: Journal of Medical Internet Research, 27 (1), e68354.
This publication has 25 references indexed in Scilit:
- Guidelines for the choice of intravenous fluids for vascular filling in critically ill patients, 2021Anaesthesia Critical Care & Pain Medicine, 2022
- Predictive Accuracy of a Perioperative Laboratory Test–Based Prediction Model for Moderate to Severe Acute Kidney Injury After Cardiac SurgeryJAMA, 2022
- Application of machine learning in liver transplantation: a reviewHepatology International, 2022
- Age shock index, shock index, and modified shock index for predicting postintubation hypotension in the emergency departmentThe American Journal of Emergency Medicine, 2020
- National prospective cohort study of the burden of acute small bowel obstructionBJS Open, 2018
- Laparoscopic versus open surgery for adhesional small bowel obstruction: a systematic review and meta-analysis of case–control studiesSurgical Endoscopy, 2018
- Thirty-day mortality in patients undergoing laparotomy for small bowel obstructionBritish Journal of Surgery, 2018
- Postoperative mortality and morbidity in older patients undergoing emergency right hemicolectomy for colon cancerAging Clinical and Experimental Research, 2016
- Emergency resection versus bridge to surgery with stenting in patients with acute right-sided colonic obstruction: a systematic review focusing on mortality and morbidity ratesInternational Journal of Colorectal Disease, 2015
- Intestinal obstruction promotes gut translocation of bacteriaDiseases of the Colon & Rectum, 1995