Under Sampling Techniques for Handling Unbalanced Data with Various Imbalance Rates: A Comparative Study
Authors:
- Esraa Abu ElsoudEEEsraa Abu Elsoud
- Omar AlidmatOAOmar Alidmat
- Mosab IgtaitMIMosab Igtait
- Mohmmad DmourMDMohmmad Dmour
Open Access
- 1 January 2024
- journal article
- Published by The Science and Information Organization in International Journal of Advanced Computer Science and Applications
- Vol. 15 (8)
Abstract
Unbalanced data sets represent data sets that contain an unequal number of examples for different classes. This dataset represents a problem faced by machine learning tools; as in datasets with high imbalance ratios, false negative rate per-centages will be increased because most classifiers will be affected by the major class. Choosing specific evaluation metrics that are most informative and sampling techniques represent a common way to handle this problem. In this paper, a comparative analysis between four of the most common under-sampling techniques is conducted over datasets with various imbalance rates (IR) range from low to medium to high IR. Decision Tree classifier and twelve imbalanced data sets with various IR are used for evaluating the effects of each technique depending on Recall, F1-measure, gmean, recall for minor class, and F1-measure for minor class evaluation metrics. Results demonstrate that Clusters Centroid outperformed Neighborhood Cleaning Rule (NCL) based on recall for all low IR datasets. For both medium, and high IR datasets NCL, and Random Under Sampling (RUS) outperformed the rest techniques, while Tomek Link has the worst effect.Keywords
This publication has 29 references indexed in Scilit:
- Simulation of Crowd Evacuation in Asymmetrical Exit Layout Based on Improved Dynamic Parameters ModelIEEE Access, 2024
- Application of machine learning in chemical engineering: outlook and perspectivesIAES International Journal of Artificial Intelligence (IJ-AI), 2024
- Deep learning algorithms to improve COVID-19 classification based on CT imagesBulletin of Electrical Engineering and Informatics, 2022
- Fusion-based anomaly detection system using modified isolation forest for internet of thingsJournal of Ambient Intelligence and Humanized Computing, 2022
- Recent Biomimetic Approaches for Articular Cartilage Tissue Engineering and Their Clinical Applications: Narrative Review of the LiteratureAdvances in Orthopedics, 2022
- Feature selection methods on gene expression microarray data for cancer classification: A systematic reviewComputers in Biology and Medicine, 2022
- A Novel Method for Identification of Glutarylation Sites Combining Borderline-SMOTE With Tomek Links Technique in Imbalanced DataIEEE/ACM Transactions on Computational Biology and Bioinformatics, 2021
- Intelligent system based on data mining techniques for prediction of preterm birth for women with cervical cerclageComputational Biology and Chemistry, 2020
- A hybrid gene selection method for microarray recognitionBiocybernetics and Biomedical Engineering, 2018
- Learning from imbalanced data: open challenges and future directionsProgress in Artificial Intelligence, 2016