Training cost-sensitive Deep Belief Networks on imbalance data problems
Authors:
- 3 November 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4362-4367
Abstract
Many real-world problems are usually unbalanced, where datasets present skewed class distributions, such as failure diagnosis, spam detection, anomaly detection, fraud detection, oil spillage detection and medical diagnosis, etc. Deep Belief Network (DBN) is a competitive machine learning technique with good performance in many applications. However, some machine learning methods are likely to give poor performance with imbalanced data between classes since they assume equal costs for each class intrinsically. To deal with this problem, existing researches only focus on sampling based approaches and lack of studies about cost-sensitive based approaches. This paper proposes cost-sensitive Deep Belief Networks for such imbalanced classification problems. The proposed approach is extended to multi-class scenario. Unequalized misclassification costs between classes have been applied to DBN. Extensive comparison with extreme learning machines is provided as a proof of the ability of the proposed approach to perform competitively on imbalanced datasets. An evolutionary algorithm is also implemented to optimize the misclassification costs for each class in cost matrix.Keywords
This publication has 20 references indexed in Scilit:
- Optimised probabilistic active learning (OPAL)Machine Learning, 2015
- Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced DataIEEE Transactions on Neural Networks and Learning Systems, 2013
- Weighted extreme learning machine for imbalance learningNeurocomputing, 2013
- Acoustic Modeling Using Deep Belief NetworksIEEE Transactions on Audio, Speech, and Language Processing, 2011
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009
- Extreme learning machine: Theory and applicationsNeurocomputing, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Class-Dependant Resampling for Medical Applications2006
- Training cost-sensitive neural networks with methods addressing the class imbalance problemIEEE Transactions on Knowledge and Data Engineering, 2005
- Adaptive Fraud DetectionData Mining and Knowledge Discovery, 1997