Empirical Analysis of Machine Learning and Stacking Ensemble Methods for Heart Disease Detection
- 21 April 2025
- journal article
- Published by World Scientific Pub Co Pte Ltd in Journal of Information & Knowledge Management
- Vol. 24 (04)
Abstract
Cardiovascular diseases are prominent contributors to mortality worldwide, and timely identification is crucial for enhancing patient prognosis. The protracted and exhaustive diagnostic procedures that result in delayed diagnosis can culminate in precarious circumstances that are difficult or impossible to manage. The utilisation of machine learning (ML) methodologies has the potential to facilitate the timely prediction of heart disease based on specific medical reports, thereby affording individuals the convenience of conducting such assessments from the comfort of their own homes. Using a dataset consisting of medical records and clinical attributes, ten models were evaluated, including decision tree, [ ]-nearest neighbours, gradient boosting, random forest, AdaBoost, support vector machine, logistic regression, naive Bayes, a hypertuned gradient boosting model, and a StackingCV ensemble model. Utilising performance metrics such as accuracy, precision, recall, [ ]1-scores, and the ROC-AUC, their predictive capabilities were evaluated. The random forest classifier achieved an accuracy of 0.94, demonstrating its high discriminatory power in identifying cases of cardiovascular disease. With an accuracy of 0.91, the [ ]-nearest neighbours model demonstrated its potential for accurate classification. Intriguingly, the hypertuned gradient boosting model significantly outperformed the baseline model, achieving an impressive accuracy of 0.96. Additionally, the StackingCV ensemble model demonstrated superior accuracy, recall, [ ]1-scores, and an ROC–AUC of 0.99, surpassing all the individual classifiers. These results demonstrate the effectiveness of ML algorithms in the detection of heart disease. The random forest classifier, the hypertuned gradient boosting model, and the StackingCV ensemble models demonstrate high accuracy and show promise for implementation in clinical settings.Keywords
This publication has 36 references indexed in Scilit:
- A Framework for Cardiac Arrest Prediction via Application of Ensemble Learning Using Boosting AlgorithmsProcedia Computer Science, 2024
- Improving the accuracy of diagnosing and predicting coronary heart disease using ensemble method and feature selection techniquesCluster Computing, 2023
- A classification and regression tree algorithm for heart disease modeling and predictionHealthcare Analytics, 2022
- The Global Burden of Cardiovascular Diseases and RiskJACC, 2022
- Application of stacking ensemble learning model in quantitative analysis of biomaterial activityMicrochemical Journal, 2022
- Stacking Ensemble-Based Intelligent Machine Learning Model for Predicting Post-COVID-19 ComplicationsNew Generation Computing, 2021
- Heart Disease Prediction using Machine Learning TechniquesSN Computer Science, 2020
- Logistic regression was as good as machine learning for predicting major chronic diseasesJournal of Clinical Epidemiology, 2020
- Prediction of Heart Disease Using Classification Based Data Mining Techniques2014
- KNN Model-Based Approach in Classification2003