The imbalance problem: A comparison of sampling approaches using different parameters and feature selection methods in the context of classification
- 22 March 2024
- journal article
- research article
- Published by Wiley in Expert Systems
- Vol. 41 (8)
Abstract
A common situation in classification tasks is to deal with unbalanced datasets, an issue that appears when the majority class(es) has a large number of samples compared to the minority class(es). This problem is even more significant when the datasets have a large number of features but only a few samples, as is the case with microarray datasets. Traditionally, an approach to alleviate this problem has been the application of sampling methods to obtain more balanced classes, increasing the number of samples in the minority class (replicating samples or generating new synthetic samples), or decreasing the number of samples in the majority class. In this study, we have compared different balancing methods, including a novel method that applies sampling in both the minority and majority classes. The interest in applying feature selection in combination with balancing methods has also been explored. In view of the results, a recommendation of sampling method, feature selection, and classifier is proposed to improve the classification results according to the type of dataset.Keywords
Funding Information
- Consellería de Cultura, Educación e Ordenación Universitaria, Xunta de Galicia
- Ministerio de Ciencia e Innovación
- Xunta de Galicia (ED431C 2022/44)
This publication has 30 references indexed in Scilit:
- Dealing with heterogeneity in the context of distributed feature selection for classificationKnowledge and Information Systems, 2020
- An empirical comparison and evaluation of minority oversampling techniques on a large number of imbalanced datasetsApplied Soft Computing, 2019
- REMEDIAL-HwR: Tackling multilabel imbalance through label decoupling and data resampling hybridizationNeurocomputing, 2019
- Comparing the Behavior of Oversampling and Undersampling Approach of Class Imbalance Learning by Combining Class Imbalance Problem with Noise2017
- S-SulfPred: A sensitive predictor to capture S-sulfenylation sites based on a resampling one-sided selection undersampling-synthetic minority oversampling techniqueJournal of Theoretical Biology, 2017
- Learning from class-imbalanced data: Review of methods and applicationsExpert Systems with Applications, 2017
- Coupling different methods for overcoming the class imbalance problemNeurocomputing, 2015
- A review of microarray datasets and applied feature selection methodsInformation Sciences, 2014
- On the effectiveness of preprocessing methods when dealing with different levels of class imbalanceKnowledge-Based Systems, 2012
- A Multiple Expert Approach to the Class Imbalance Problem Using Inverse Random under Sampling2009