Optimizing Machine Learning for Healthcare Applications: A Case Study on Cardiovascular Disease Prediction Through Feature Selection, Regularization, and Overfitting Reduction
Open Access
- 7 July 2025
- conference paper
- Published by MDPI AG in Computer Sciences & Mathematics Forum
- Vol. 10 (1) , 13
Abstract
The application of machine learning (ML) to medical datasets offers significant potential for improving disease prediction and patient outcomes. However, challenges such as feature redundancy, overfitting, and suboptimal model performance limit the practical effectiveness of ML algorithms. This study focuses on optimizing ML techniques for cardiovascular disease prediction using the Kaggle Cardiovascular Disease dataset. We systematically apply feature selection methods, including correlation analysis and regularization techniques (L1/L2), to identify the most relevant attributes and address multicollinearity. Advanced ensemble models such as Random Forest, XGBoost, and LightGBM are employed to mitigate overfitting and enhance predictive performance. Through hyperparameter tuning and stratified k-fold cross-validation, we ensure model robustness and generalizability. The results demonstrate that ensemble methods, particularly gradient boosting algorithms, outperform traditional models, achieving superior predictive accuracy and stability. This study highlights the importance of algorithm optimization in ML applications for healthcare, offering a replicable framework for medical datasets and paving the way for more effective diagnostic tools in cardiovascular health.Keywords
This publication has 21 references indexed in Scilit:
- Novel framework of significant risk factor identification and cardiovascular disease predictionExpert Systems with Applications, 2024
- A one-dimensional convolutional neural network-based deep learning approach for predicting cardiovascular diseasesInformatics in Medicine Unlocked, 2024
- Artificial intelligence for cardiovascular disease risk assessment in personalised framework: a scoping revieweClinicalMedicine, 2024
- Machine learning approach for predicting cardiovascular disease in Bangladesh: evidence from a cross-sectional study in 2023BMC Cardiovascular Disorders, 2024
- Evaluation metrics and statistical tests for machine learningScientific Reports, 2024
- Healthcare predictive analytics using machine learning and deep learning techniques: a surveyJournal of Electrical Systems and Information Technology, 2023
- Deep neural networks with L1 and L2 regularization for high dimensional corporate credit risk predictionExpert Systems with Applications, 2022
- On Splitting Training and Validation Set: A Comparative Study of Cross-Validation, Bootstrap and Systematic Sampling for Estimating the Generalization Performance of Supervised LearningJournal of Analysis and Testing, 2018
- Prediction using step-wise L1, L2 regularization and feature selection for small data sets with large number of featuresBMC Bioinformatics, 2011
- Pearson’s Correlation Coefficient2008