COMPARATIVE ANALYSIS OF CLASSIFICATION ALGORITHMS IN HANDLING IMBALANCED DATA WITH SMOTE OVERSAMPLING APPROACH
Open Access
- 27 November 2025
- journal article
- Published by LPPM Universitas Nusa Mandiri in JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer)
- Vol. 11 (2) , 487-495
Abstract
Most machine learning algorithms tend to yield optimal results when trained on datasets with balanced class proportions. However, their performance usually declines when applied to data with significant class imbalance. To address this issue, this study utilizes the Synthetic Minority Oversampling Technique (SMOTE) to improve class distribution before model training. Several classification algorithms were employed, including Decision Tree, K-Nearest Neighbors, Logistic Regression, Support Vector Machine, and Random Forest. Experimental results reveal that the Random Forest model produced the highest accuracy (95.70%) and the best F1-score, demonstrating a well-balanced trade-off between precision and recall. In contrast, the Logistic Regression algorithm achieved the highest recall (74.20%), indicating better sensitivity in identifying positive instances despite a lower F1-score. These outcomes highlight the importance of choosing appropriate classification methods based on the specific evaluation goals whether prioritizing accuracy, recall, or overall model balance.Keywords
This publication has 33 references indexed in Scilit:
- A new technique for classification method with imbalanced training dataInternational Journal of Information Technology, 2024
- The class imbalance problem in deep learningMachine Learning, 2022
- SMOTE-LOF for noise identification in imbalanced data classificationJournal of King Saud University Computer and Information Sciences, 2022
- A Review on Unbalanced Data Classification2022
- SMOTE-RkNN: A hybrid re-sampling method based on SMOTE and reverse k-nearest neighborsInformation Sciences, 2022
- Feature Selection in Imbalanced DataAnnals of Data Science, 2022
- Performance enrichment through parameter tuning of random forest classification for imbalanced data applicationsMaterials Today: Proceedings, 2022
- A Relabeling Approach to Handling the Class Imbalance Problem for Logistic RegressionJournal of Computational and Graphical Statistics, 2021
- Improving logistic regression on the imbalanced data by a novel penalized log-likelihood functionJournal of Applied Statistics, 2021
- Review of Classification Methods on Unbalanced Data SetsIEEE Access, 2021