Electronic Medical Record–Based Machine Learning Approach to Predict the Risk of 30-Day Adverse Cardiac Events After Invasive Coronary Treatment: Machine Learning Model Development and Validation
Authors:
- Osung KwonOsung Kwon
- Wonjun NaWNWonjun Na
- Heejun KangHKHeejun Kang
- Tae Joon JunTJTae Joon Jun
- Jihoon KweonJKJihoon Kweon
- Gyung-Min ParkGPGyung-Min Park
- YongHyun ChoYCYongHyun Cho
- Cinyoung HurCHCinyoung Hur
- Jungwoo ChaeJCJungwoo Chae
- Do-Yoon KangDKDo-Yoon Kang
- Pil Hyung LeePLPil Hyung Lee
- Jung-Min AhnJAJung-Min Ahn
Open Access
- 11 May 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 10 (5) , e26801
Abstract
Background: Although there is a growing interest in prediction models based on electronic medical records (EMRs) to identify patients at risk of adverse cardiac events following invasive coronary treatment, robust models fully utilizing EMR data are limited. Objective: We aimed to develop and validate machine learning (ML) models by using diverse fields of EMR to predict the risk of 30-day adverse cardiac events after percutaneous intervention or bypass surgery. Methods: EMR data of 5,184,565 records of 16,793 patients at a quaternary hospital between 2006 and 2016 were categorized into static basic (eg, demographics), dynamic time-series (eg, laboratory values), and cardiac-specific data (eg, coronary angiography). The data were randomly split into training, tuning, and testing sets in a ratio of 3:1:1. Each model was evaluated with 5-fold cross-validation and with an external EMR-based cohort at a tertiary hospital. Logistic regression (LR), random forest (RF), gradient boosting machine (GBM), and feedforward neural network (FNN) algorithms were applied. The primary outcome was 30-day mortality following invasive treatment. Results: GBM showed the best performance with area under the receiver operating characteristic curve (AUROC) of 0.99; RF had a similar AUROC of 0.98. AUROCs of FNN and LR were 0.96 and 0.93, respectively. GBM had the highest area under the precision-recall curve (AUPRC) of 0.80, and the AUPRCs of RF, LR, and FNN were 0.73, 0.68, and 0.63, respectively. All models showed low Brier scores of 0.95, contributing majorly to the excellent results. Conclusions: Exploiting the diverse fields of the EMR data set, the ML-based 30-day adverse cardiac event prediction models demonstrated outstanding results, and the applied framework could be generalized for various health care prediction models.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- MACE prediction of acute coronary syndrome via boosted resampling classification using electronic medical recordsJournal of Biomedical Informatics, 2017
- Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challengesEuropean Heart Journal, 2016
- Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic reviewJournal of the American Medical Informatics Association, 2016
- Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing modelsBMC Medical Informatics and Decision Making, 2015
- Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statementBMJ, 2014
- Characteristics Desired in Clinical Data Warehouse for Biomedical ResearchHealthcare Informatics Research, 2014
- Risk Score for Predicting Long-Term Mortality After Coronary Artery Bypass Graft SurgeryCirculation, 2012
- Prediction of Long-Term Mortality After Percutaneous Coronary Intervention in Older AdultsCirculation, 2012
- Contemporary and evolving risk scoring algorithms for percutaneous coronary interventionHeart, 2011
- Cardiovascular Risk Prediction in Patients With Stable and Unstable Coronary Heart DiseaseCirculation, 2010