Nearest Neighbor Classification based on Imbalanced Data: A Statistical Approach
Preprint
Abstract
When the competing classes in a classification problem are not of comparable size, many popular classifiers exhibit a bias towards larger classes, and the nearest neighbor classifier is no exception. To take care of this problem, we develop a statistical method for nearest neighbor classification based on such imbalanced data sets. First, we construct a classifier for the binary classification problem and then extend it for classification problems involving more than two classes. Unlike the existing oversampling or undersampling methods, our proposed classifiers do not need to generate any pseudo observations or remove any existing observations, hence the results are exactly reproducible. We establish the Bayes risk consistency of these classifiers under appropriate regularity conditions. Their superior performance over the existing methods is amply demonstrated by analyzing several benchmark data sets.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Clustering-based undersampling in class-imbalanced dataInformation Sciences, 2017
- An instance level analysis of data complexityMachine Learning, 2013
- Training and assessing classification rules with imbalanced dataData Mining and Knowledge Discovery, 2012
- On hybrid classification using model assisted posterior estimatesPattern Recognition, 2012
- Classification Based on Hybridization of Parametric and Nonparametric ClassifiersIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- ADASYN: Adaptive synthetic sampling approach for imbalanced learning2008
- On Nearest Neighbor Classification Using Adaptive Choice ofkJournal of Computational and Graphical Statistics, 2007
- Asymptotic Properties of Nearest Neighbor Rules Using Edited DataIEEE Transactions on Systems, Man, and Cybernetics, 1972
- Nearest neighbor pattern classificationIEEE Transactions on Information Theory, 1967
- A Nonparametric Estimate of a Multivariate Density FunctionThe Annals of Mathematical Statistics, 1965