Machine learning versus traditional risk stratification methods in acute coronary syndrome: a pooled randomized clinical trial analysis
- 18 September 2019
- journal article
- research article
- Published by Springer Nature in Journal of Thrombosis and Thrombolysis
- Vol. 49 (1) , 1-9
Abstract
Traditional statistical models allow population based inferences and comparisons. Machine learning (ML) explores datasets to develop algorithms that do not assume linear relationships between variables and outcomes and that may account for higher order interactions to make individualized outcome predictions. To evaluate the performance of machine learning models compared to traditional risk stratification methods for the prediction of major adverse cardiovascular events (MACE) and bleeding in patients with acute coronary syndrome (ACS) that are treated with antithrombotic therapy. Data on 24,178 ACS patients were pooled from four randomized controlled trials. The super learner ensemble algorithm selected weights for 23 machine learning models and was compared to traditional models. The efficacy endpoint was a composite of cardiovascular death, myocardial infarction, or stroke. The safety endpoint was a composite of TIMI major and minor bleeding or bleeding requiring medical attention. For the MACE outcome, the super learner model produced a higher c-statistic (0.734) than logistic regression (0.714), the TIMI risk score (0.489), and a new cardiovascular risk score developed in the dataset (0.644). For the bleeding outcome, the super learner demonstrated a similar c-statistic as the logistic regression model (0.670 vs. 0.671). The machine learning risk estimates were highly calibrated with observed efficacy and bleeding outcomes (Hosmer–Lemeshow p value = 0.692 and 0.970, respectively). The super learner algorithm was highly calibrated on both efficacy and safety outcomes and produced the highest c-statistic for prediction of MACE compared to traditional risk stratification methods. This analysis demonstrates a contemporary application of machine learning to guide patient-level antithrombotic therapy treatment decisions. Clinical Trial Registration ATLAS ACS-2 TIMI 46: https://clinicaltrials.gov/ct2/show/NCT00402597 . Unique Identifier: NCT00402597. ATLAS ACS-2 TIMI 51: https://clinicaltrials.gov/ct2/show/NCT00809965 . Unique Identifier: NCT00809965. GEMINI ACS-1: https://clinicaltrials.gov/ct2/show/NCT02293395 . Unique Identifier: NCT02293395. PIONEER-AF PCI: https://clinicaltrials.gov/ct2/show/NCT01830543 . Unique Identifier: NCT01830543.Keywords
Funding Information
- Janssen Pharmaceuticals Inc.
This publication has 31 references indexed in Scilit:
- Machine Learning in MedicineCirculation, 2015
- An open-label, randomized, controlled, multicenter study exploring two treatment strategies of rivaroxaban and a dose-adjusted oral vitamin k antagonist treatment strategy in subjects with atrial fibrillation who undergo percutaneous coronary intervention (PIONEER AF-PCI)American Heart Journal, 2015
- Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): a population-based studyThe Lancet Respiratory Medicine, 2015
- Using methods from the data-mining and machine-learning literature for disease classification and prediction: a case study examining classification of heart failure subtypesJournal of Clinical Epidemiology, 2013
- 2013 ACCF/AHA Guideline for the Management of ST-Elevation Myocardial InfarctionCirculation, 2013
- Rivaroxaban in Patients with a Recent Acute Coronary SyndromeNew England Journal of Medicine, 2012
- Acute Coronary Syndromes: Diagnosis and Management, Part IMayo Clinic Proceedings, 2009
- Rivaroxaban versus placebo in patients with acute coronary syndromes (ATLAS ACS-TIMI 46): a randomised, double-blind, phase II trialThe Lancet, 2009
- A Validated Prediction Model for All Forms of Acute Coronary SyndromeJAMA, 2004
- The TIMI Risk Score for Unstable Angina/Non–ST Elevation MIJAMA, 2000