Bayes Vector Quantizer for Class-Imbalance Problem
- 12 September 2008
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 21 (5) , 638-651
Abstract
The class-imbalance problem is the problem of learning a classification rule from data that are skewed in favor of one class. On these datasets traditional learning techniques tend to overlook the less numerous class, at the advantage of the majority class. However, the minority class is often the most interesting one for the task at hand. For this reason, the class-imbalance problem has received increasing attention in the last few years. In the present paper we point the attention of the reader to a learning algorithm for the minimization of the average misclassification risk. In contrast to some popular class-imbalance learning methods, this method has its roots in statistical decision theory. A particular interesting characteristic is that when class distributions are unknown, the method can work by resorting to stochastic gradient algorithm. We study the behavior of this algorithm on imbalanced datasets, demonstrating that this principled approach allows to obtain better classification performances compared to the principal methods proposed in the literature.Keywords
This publication has 24 references indexed in Scilit:
- Active Learning for Probability Estimation Using Jensen-Shannon Divergence2005
- Mining with rarityACM SIGKDD Explorations Newsletter, 2004
- An instance-weighting method to induce cost-sensitive treesIEEE Transactions on Knowledge and Data Engineering, 2002
- Non-linear dimensionality reduction techniques for classification and visualization2002
- An efficient and scalable data compression approach to classificationACM SIGKDD Explorations Newsletter, 2000
- Quantizing for minimum average misclassification riskIEEE Transactions on Neural Networks, 1998
- Learning when negative examples abound1997
- Neural Network Classifiers Estimate Bayesian a posteriori ProbabilitiesNeural Computation, 1991
- The self-organizing mapProceedings of the IEEE, 1990
- The condensed nearest neighbor rule (Corresp.)IEEE Transactions on Information Theory, 1968