A cluster-based hybrid sampling approach for imbalanced data classification
Authors:
- 1 May 2020
- journal article
- conference paper
- Published by AIP Publishing in Review of Scientific Instruments
- Vol. 91 (5) , 055101
Abstract
When processing instrumental data by using classification approaches, the imbalanced dataset problem is usually challenging. As the minority class instances could be overwhelmed by the majority class instances, training a typical classifier with such a dataset directly might get poor results in classifying the minority class. We propose a cluster-based hybrid sampling approach CUSS (Cluster-based Under-sampling and SMOTE) for imbalanced dataset classification, which belongs to the type of data-level methods and is different from previously proposed hybrid methods. A new cluster-based under-sampling method is designed for CUSS, and a new strategy to set the expected instance number according to data distribution in the original training dataset is also proposed in this paper. The proposed method is compared with five other popular resampling methods on 15 datasets with different instance numbers and different imbalance ratios. The experimental results show that the CUSS method has good performance and outperforms other state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (61971153 and Fundamental Research Funds for the Central Universities (Grant No. 3072020CFJ0805))
This publication has 24 references indexed in Scilit:
- Classifying imbalanced data sets using similarity based hierarchical decompositionPattern Recognition, 2015
- Undersampled $K$ K -means approach for handling imbalanced distributed dataProgress in Artificial Intelligence, 2014
- An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristicsInformation Sciences, 2013
- A hybrid method to face class overlap and class imbalance on neural networks and multi-class scenariosPattern Recognition Letters, 2013
- The Research of Imbalanced Data Set of Sample Sampling Method Based on K-Means Cluster and Genetic AlgorithmEnergy Procedia, 2012
- Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of powerInformation Sciences, 2010
- Cluster-based under-sampling approaches for imbalanced data distributionsExpert Systems with Applications, 2009
- A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretabilitySoft Computing, 2008
- KEEL: a software tool to assess evolutionary algorithms for data mining problemsSoft Computing, 2008
- On the k-NN performance in a challenging scenario of imbalance and overlappingPattern Analysis and Applications, 2007