Using Machine Learning to Predict Outcomes Following Transfemoral Carotid Artery Stenting
Authors:
- Ben LiBLBen Li
- Naomi EisenbergNENaomi Eisenberg
- Derek BeatonDBDerek Beaton
- Douglas S. LeeDLDouglas S. Lee
- Duminda N. WijeysunderaDWDuminda N. Wijeysundera
- Mohamad A. HussainMHMohamad A. Hussain
- Ori D. RotsteinOROri D. Rotstein
- Charles de MestralCMCharles de Mestral
- Muhammad MamdaniMMMuhammad Mamdani
- Graham Roche‐NagleGRGraham Roche‐Nagle
- Mohammed Al‐OmranMAMohammed Al‐Omran
Open Access
- 3 September 2024
- journal article
- research article
- Published by Wolters Kluwer Health in Journal of the American Heart Association
- Vol. 13 (17) , e035425
Abstract
Background: Transfemoral carotid artery stenting (TFCAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision‐making but remain limited. We developed machine learning algorithms that predict 1‐year stroke or death following TFCAS. Methods and Results: The VQI (Vascular Quality Initiative) database was used to identify patients who underwent TFCAS for carotid artery stenosis between 2005 and 2024. We identified 112 features from the index hospitalization (82 preoperative [demographic/clinical], 13 intraoperative [procedural], and 17 postoperative [in‐hospital course/complications]). The primary outcome was 1‐year postprocedural stroke or death. The data were divided into training (70%) and test (30%) sets. Six machine learning models were trained using preoperative features with 10‐fold cross‐validation. The primary model evaluation metric was area under the receiver operating characteristic curve. The algorithm with the best performance was further trained using intra‐ and postoperative features. Model robustness was assessed using calibration plots and Brier scores. Overall, 35 214 patients underwent TFCAS during the study period and 3257 (9.2%) developed 1‐year stroke or death. The best preoperative prediction model was extreme gradient boosting, achieving an area under the receiver operating characteristic curve of 0.94 (95% CI, 0.93–0.95). In comparison, logistic regression had an AUROC of 0.65 (95% CI, 0.63–0.67). The extreme gradient boosting model maintained excellent performance at the intra‐ and postoperative stages, with area under the receiver operating characteristic curve values of 0.94 (95% CI, 0.93–0.95) and 0.98 (95% CI, 0.97–0.99), respectively. Calibration plots showed good agreement between predicted/observed event probabilities with Brier scores of 0.11 (preoperative), 0.11 (intraoperative), and 0.09 (postoperative). Conclusions: Machine learning can accurately predict 1‐year stroke or death following TFCAS, performing better than logistic regression.Keywords
This publication has 65 references indexed in Scilit:
- Machine Learning Algorithms for Predicting Surgical Outcomes after Colorectal Surgery: A Systematic ReviewWorld Journal of Surgery, 2022
- Carotid Artery StentingJACC, 2022
- Machine learning versus logistic regression for prognostic modelling in individuals with non-specific neck painEuropean Spine Journal, 2022
- Carotid Artery Stenting in Asymptomatic Carotid Artery StenosisJACC, 2020
- Potential Biases in Machine Learning Algorithms Using Electronic Health Record DataJAMA Internal Medicine, 2018
- Adapting machine learning techniques to censored time-to-event health record data: A general-purpose approach using inverse probability of censoring weightingJournal of Biomedical Informatics, 2016
- Introduction to Machine Learning2013
- Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aid and Informed Consent Tool for Patients and SurgeonsJournal of the American College of Surgeons, 2013
- Preoperative medical consultation: maximizing its benefitsThe American Journal of Surgery, 2012
- Assessing predictive accuracy: How to compare brier scoresJournal of Clinical Epidemiology, 1991