Quartiles based UnderSampling(QUS): A Simple and Novel Method to increase the Classification rate of positives in Imbalanced Datasets
Authors:
- 1 December 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
The main challenge in learning from imbalanced datasets is the presence of a large set of training examples available for the negatives(majority class instances), and very few positives(minority class instances). This may result in a good overall performance of the classifier even though there is a huge red uction in the classification rate of positives. Quartiles based UnderSampling(QUS) method proposed in this paper, addresses the above problem in a simple way. That is balancing the dataset by selecting the negatives based on their similarity with respect to 5 quartiles: minimum, quartile1(Q1), median, quartile3(Q3) and maximum. Intention is to reduce the influence of excessive negatives on the classifier, which may bias it towards a better negatives classification otherwise. An advantage of this undersampling method is parameter independence and gives better results compared to the state of the art methods. The proposed method is tested on kNN (k Nearest Neighbour) classifier and empirical results improve the classification rate of positives than the original unprocessed imbalanced dataset.Keywords
This publication has 13 references indexed in Scilit:
- A novel ensemble method for classifying imbalanced dataPattern Recognition, 2015
- Classifying imbalanced data sets using similarity based hierarchical decompositionPattern Recognition, 2015
- Neighbourhood sampling in bagging for imbalanced dataNeurocomputing, 2015
- A proposal for evolutionary fuzzy systems using feature weighting: Dealing with overlapping in imbalanced datasetsKnowledge-Based Systems, 2015
- Multi-Cluster Based Approach for skewed Data in Data MiningIOSR Journal of Computer Engineering, 2013
- Addressing the Class Imbalance Problem in Medical DatasetsInternational Journal of Machine Learning and Computing, 2013
- DBSMOTE: Density-Based Synthetic Minority Over-sampling TEchniqueApplied Intelligence, 2011
- Cluster-based under-sampling approaches for imbalanced data distributionsExpert Systems with Applications, 2009
- A study of the behavior of several methods for balancing machine learning training dataACM SIGKDD Explorations Newsletter, 2004
- The condensed nearest neighbor rule (Corresp.)IEEE Transactions on Information Theory, 1968