Feature Selection and Discretization based on Mutual Information
- 1 January 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 20, 1-6
Abstract
Feature selection and discretization have been considered to be an important research topic in the field of pattern recognition and data mining. However, addressing both these issues at a time is rarely discussed in the existing research. In this paper, these issues have been addressed by developing a heuristic namely discretization and selection of features based on mutual information (DSM). Experimental results on 15 datasets show that the proposed DSM outperforms a number of state-of-the-art feature selection or discretization algorithms. On average, its accuracy surpasses that of the best performing state-of-the-art algorithms by 5% using Support Vector Machine. Moreover, for datasets with a large number of features, it shows promising accuracies even with far less number of features than the other competing algorithms.Keywords
This publication has 22 references indexed in Scilit:
- Feature Discretization with Relevance and Mutual Information Criteria2014
- ur-CAIM: improved CAIM discretization for unbalanced and balanced dataSoft Computing, 2014
- A new approach for discretizing continuous attributes in learning systemsNeurocomputing, 2014
- On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual InformationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Normalized Mutual Information Feature SelectionIEEE Transactions on Neural Networks, 2009
- MODL: A Bayes optimal discretization method for continuous attributesMachine Learning, 2006
- Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Discretization of Continuous Attributes in Rough Set Theory and Its Application2004
- Discretization: An Enabling TechniqueData Mining and Knowledge Discovery, 2002
- A Bayesian Discretizer for Real-Valued AttributesThe Computer Journal, 1996