CSS: Handling imbalanced data by improved clustering with stratified sampling
- 22 December 2020
- journal article
- research article
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 34 (2)
Abstract
Summary: The traditional support vector machine technique (SVM) has drawbacks in dealing with imbalanced data. To address this issue, in this paper we propose an algorithm of improved clustering with stratified sampling technique (CSS) to improve the classification performance of SVMs on imbalanced datasets. Instead of applying a single type of sampling method as used in the literature, our algorithm treats different type of classes with different sampling methods. For minority classes, the algorithm uses oversampling method by adding noise which obeys normal distribution around every support vector to generate new samples. For majority classes, samples are first divided into different clusters by applying first the improved clustering by fast search to find of density peaks (CFSFDP) to obtain latent structure information in each majority class and then stratified sampling method is applied to extract samples from each subcluster of the majority class. Moreover, we further extend this method into an ensemble classifiers that use multiple base SVM classifiers for prediction. The experimental results of classification on several imbalanced classification datasets show that our CSS is more effective than the state‐of‐the‐art sampling methods.Keywords
Funding Information
- National Natural Science Foundation of China (61771347)
This publication has 41 references indexed in Scilit:
- A novel ensemble method for classifying imbalanced dataPattern Recognition, 2015
- SMOTE–IPF: Addressing the noisy and borderline examples problem in imbalanced classification by a re-sampling method with filteringInformation Sciences, 2015
- RWO-Sampling: A random walk over-sampling approach to imbalanced data classificationInformation Fusion, 2014
- Learned lessons in credit card fraud detection from a practitioner perspectiveExpert Systems with Applications, 2014
- Clustering by fast search and find of density peaksScience, 2014
- DBSMOTE: Density-Based Synthetic Minority Over-sampling TEchniqueApplied Intelligence, 2011
- Cluster-based under-sampling approaches for imbalanced data distributionsExpert Systems with Applications, 2009
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005
- Training with Noise is Equivalent to Tikhonov RegularizationNeural Computation, 1995
- The condensed nearest neighbor rule (Corresp.)IEEE Transactions on Information Theory, 1968