Development, validation, and clinical evaluation of a machine-learning based model for diagnosing early infection after cardiovascular surgery (DEICS): a multi-center cohort study
Open Access
- 4 February 2025
- journal article
- research article
- Published by Wolters Kluwer Health in International Journal of Surgery
- Vol. 111 (4) , 2862-2871
Abstract
Background: This study addresses the critical need for timely and accurate diagnosis of early postoperative infection (EPI) following cardiac surgery. EPI significantly impacts patient outcomes and healthcare costs, making its early detection vital. Objectives: To develop, validate, and clinically implement a machine-learning-based model for diagnosing EPI post-cardiac surgery, enhancing postoperative care. Methods: In this multi-center cohort study spanning 2020 to 2022, data from four medical centers involved 2001 participants. Of these, 1400 were used for trainingand 601 for validation. Several machines-learning algorithms, including XGBoost, random forest, support vector machines, least absolute shrinkage and selection operator, and single-layer neural networks, were applied to develop predictive models. These were compared against a traditional logistic regression model. The model with the highest area under the receiver operating characteristic curve (AUROC) was deemed optimal. Implemented across four centers since 1 January 2023, a retrospective real-world study assessed its clinical applicability. Among 400 patients with an estimated EPI risk above 10%, identified by the optimal model, 55 followed its antibiotic upgrade recommendations (DEICS group). The remaining 345 patients upgraded antibiotics empirically, with 55 in the control group, matched 1:1 with the DEICS group. Clinical utility was evaluated through antibiotic use density (AUD), hospital costs, and ICU stay duration. Results: The XGBoost model achieved the highest performance with an AUROC of 0.96 (95% CI: 0.93–0.98). The calibration curve exhibited strong agreement with Brier scores of 0.02. According to the XGBoost model, the DEICS group significantly demonstrated reduced AUD (P < 0.01) in the matched cohort, along with decreased ICU stay time (median: 5 vs. 6 days, P = 0.01) and hospital costs (median: ¥150 000 vs. median: ¥200 000, P = 0.01) in the EPI cohort. Conclusion: The successful implementation of the XGBoost model facilitates accurate EPI diagnosis, improves postoperative recovery, and lowers hospital costs.Keywords
This publication has 24 references indexed in Scilit:
- Impact of Postoperative Infections on Readmission and Resource Use in Elective Cardiac SurgeryThe Annals of Thoracic Surgery, 2022
- STROCSS 2021: Strengthening the reporting of cohort, cross-sectional and case-control studies in surgeryInternational Journal of Surgery, 2021
- Morbidity and Mortality of Nosocomial Infection after Cardiovascular Surgery: A Report of 1606 CasesCurrent Medical Science, 2018
- Centers for Disease Control and Prevention Guideline for the Prevention of Surgical Site Infection, 2017JAMA Surgery, 2017
- A novel score to estimate the risk of pneumonia after cardiac surgeryThe Journal of Thoracic and Cardiovascular Surgery, 2016
- Costs Associated With Health Care–Associated Infections in Cardiac SurgeryJACC, 2015
- Ventilator-associated pneumonia after cardiac surgery: A meta-analysis and systematic reviewThe Journal of Thoracic and Cardiovascular Surgery, 2014
- Hospitalization before surgery increases risk for postoperative infectionsThe Journal of Thoracic and Cardiovascular Surgery, 2014
- Quantifying the incremental cost of complications associated with mitral valve surgery in the United StatesThe Journal of Thoracic and Cardiovascular Surgery, 2012
- The Frequency and Cost of Complications Associated With Coronary Artery Bypass Grafting Surgery: Results from the United States Medicare ProgramThe Annals of Thoracic Surgery, 2008