Applying adaptive over-sampling technique based on data density and cost-sensitive SVM to imbalanced learning
Authors:
Open Access
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21614393,p. 1-8
Abstract
Resampling method is a popular and effective technique to imbalanced learning. However, most resampling methods ignore data density information and may lead to overfitting. A novel adaptive over-sampling technique based on data density (ASMOBD) is proposed in this paper. Compared with existing resampling algorithms, ASMOBD can adaptively synthesize different number of new samples around each minority sample according to its level of learning difficulty. Therefore, this method makes the decision region more specific and can eliminate noise. What's more, to avoid over generalization, two smoothing methods are proposed. Cost- Sensitive learning is also an effective technique to imbalanced learning. In this paper, ASMOBD and Cost-Sensitive SVM are combined. Experiments show that our methods perform better than various state-of-art approaches on 9 UCI datasets by using metrics of G-mean and area under the receiver operation curve (AUC).Keywords
This publication has 9 references indexed in Scilit:
- Applying Over-sampling Technique Based on Data Density and Cost-sensitive SVM to Imbalanced Learning2011
- Addressing data complexity for imbalanced data sets: analysis of SMOTE-based oversampling and evolutionary undersamplingSoft Computing, 2010
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009
- Imbalanced SVM Learning with Margin CompensationLecture Notes in Computer Science, 2008
- ADASYN: Adaptive synthetic sampling approach for imbalanced learning2008
- A study of the behavior of several methods for balancing machine learning training dataACM SIGKDD Explorations Newsletter, 2004
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002
- OPTICS1999
- Adaptive Fraud DetectionData Mining and Knowledge Discovery, 1997