Balanced Split: A new train-test data splitting strategy for imbalanced datasets
Preprint
Abstract
Classification data sets with skewed class proportions are called imbalanced. Class imbalance is a problem since most machine learning classification algorithms are built with an assumption of equal representation of all classes in the training dataset. Therefore to counter the class imbalance problem, many algorithm-level and data-level approaches have been developed. These mainly include ensemble learning and data augmentation techniques. This paper shows a new way to counter the class imbalance problem through a new data-splitting strategy called balanced split. Data splitting can play an important role in correctly classifying imbalanced datasets. We show that the commonly used data-splitting strategies have some disadvantages, and our proposed balanced split has solved those problems.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- SMOTified-GAN for Class Imbalanced Pattern Classification ProblemsIEEE Access, 2022
- Strength of Stacking Technique of Ensemble Learning in Rockburst Prediction with Imbalanced Data: Comparison of Eight Single and Ensemble ModelsNatural Resources Research, 2021
- SMOTE-WENN: Solving class imbalance and small sample problems by oversampling and distance scalingApplied Intelligence, 2020
- A survey on ensemble learningFrontiers of Computer Science, 2019
- Two-stage consumer credit risk modelling using heterogeneous ensemble learningDecision Support Systems, 2019
- Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTEInformation Sciences, 2018
- An Integrated Ensemble Learning Model for Imbalanced Fault Diagnostics and PrognosticsIEEE Access, 2018
- Ensemble learning for data stream analysis: A surveyInformation Fusion, 2017
- Addressing the class imbalance problem in Twitter spam detection using ensemble learningComputers & Security, 2017
- Sample Subset Optimization Techniques for Imbalanced and Ensemble Learning Problems in Bioinformatics ApplicationsIEEE Transactions on Cybernetics, 2013