Classifying Imbalanced Data Sets by a Novel RE-Sample and Cost-Sensitive Stacked Generalization Method
Authors:
Open Access
- 23 January 2018
- journal article
- research article
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2018, 1-13
Abstract
Learning with imbalanced data sets is considered as one of the key topics in machine learning community. Stacking ensemble is an efficient algorithm for normal balance data sets. However, stacking ensemble was seldom applied in imbalance data. In this paper, we proposed a novel RE-sample and Cost-Sensitive Stacked Generalization (RECSG) method based on 2-layer learning models. The first step is Level 0 model generalization including data preprocessing and base model training. The second step is Level 1 model generalization involving cost-sensitive classifier and logistic regression algorithm. In the learning phase, preprocessing techniques can be embedded in imbalance data learning methods. In the cost-sensitive algorithm, cost matrix is combined with both data characters and algorithms. In the RECSG method, ensemble algorithm is combined with imbalance data techniques. According to the experiment results obtained with 17 public imbalanced data sets, as indicated by various evaluation metrics (AUC, GeoMean, and AGeoMean), the proposed method showed the better classification performances than other ensemble and single algorithms. The proposed method is especially more efficient when the performance of base classifier is low. All these demonstrated that the proposed method could be applied in the class imbalance problem.Keywords
Funding Information
- Natural Science Foundation of Shanxi Province (2015011039)
This publication has 33 references indexed in Scilit:
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretabilitySoft Computing, 2008
- Automatically countering imbalance and its empirical relationship to costData Mining and Knowledge Discovery, 2008
- Cost-sensitive boosting for classification of imbalanced dataPattern Recognition, 2007
- Learning from imbalanced data sets with boosting and data generationACM SIGKDD Explorations Newsletter, 2004
- New Applications of Ensembles of ClassifiersPattern Analysis and Applications, 2003
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Combining Estimates in Regression and ClassificationJournal of the American Statistical Association, 1996
- An Introduction to Kernel and Nearest-Neighbor Nonparametric RegressionThe American Statistician, 1992
- Stacked generalizationNeural Networks, 1992