A non-parametric mixture of Gaussian naive Bayes classifiers based on local independent features
Authors:
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 209-212
Abstract
The naive Bayes is one of the useful classification techniques in data mining and machine learning. Although naive Bayes learners are efficient, they suffer from the weak assumption of conditional independence between the attributes. Many algorithms have been proposed to improve the effectiveness of naive Bayes classifier by inserting discriminant approaches into its generative structure. Combining generative and discriminative viewpoints is done in many algorithms e.g. by use of attribute weighting, instance weighting or ensemble method. In this paper, a new ensemble of Gaussian naive Bayes classifiers is proposed based on the mixture of Gaussian distributions formed on less conditional dependent features extracted by local PCA. A semi-AdaBoost approach is used for dynamic adaptation of distributions considering misclassified instances. The proposed method has been evaluated and compared with the related work on 12 UCI machine learning datasets and achievements show significant improvement on the performance.Keywords
This publication has 9 references indexed in Scilit:
- A support vector machine based naive Bayes algorithm for spam filtering2016
- Online Learning of a Weighted Selective Naive Bayes Classifier with Non-convex Optimization2016
- Experimental analysis of naïve Bayes classifier based on an attribute weighting framework with smooth kernel density estimationsApplied Intelligence, 2015
- Ensemble Learning2015
- Naive Bayes text classifiers: a locally weighted learning approachJournal of Experimental & Theoretical Artificial Intelligence, 2013
- Ensemble Machine Learning2012
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Top 10 algorithms in data miningKnowledge and Information Systems, 2007
- LEARNING THE STRUCTURE OF AUGMENTED BAYESIAN CLASSIFIERSInternational Journal on Artificial Intelligence Tools, 2002