An Integrated Mechanism for Feature Selection and Fuzzy Rule Extraction for Classification
Authors:
- 1 August 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 20 (4) , 683-698
Abstract
In our view, the most important characteristic of a fuzzy rule-based system is its readability, which is seriously affected by, among other things, the number of features used to design the rule base. Hence, for high-dimensional data, dimensionality reduction through feature selection (not extraction) is very important. Our objective, here, is not to find an optimal rule base for classification but to select a set of useful features that may solve the classification problem. For this, we present an integrated mechanism for simultaneous extraction of fuzzy rules and selection of useful features. Since the feature selection method is integrated into the rule base formation, our scheme can account for possible subtle nonlinear interaction between features, as well as that between features and the tool, and, consequently, can select a set of useful features for the classification job. We have tried our method on several commonly used datasets as well as on a synthetic dataset with dimension varying from 4 to 60. Using a ten-fold cross-validation setup, we have demonstrated the effectiveness of our method.Keywords
This publication has 51 references indexed in Scilit:
- Hybrid attribute reduction based on a novel fuzzy-rough model and information granulationPattern Recognition, 2007
- A fuzzy rule based approach to cloud cover estimationRemote Sensing of Environment, 2006
- A Neuro-Fuzzy Scheme for Simultaneous Feature Selection and Fuzzy Rule-Based ClassificationIEEE Transactions on Neural Networks, 2004
- A new scheme for fuzzy rule-based system identification and its application to self-tuning fuzzy controllersIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2002
- Three-objective genetics-based machine learning for linguistic rule extractionInformation Sciences, 2001
- An efficient fuzzy classifier with feature selection based on fuzzy entropyIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2001
- Integrated feature analysis and fuzzy rule-based system identification in a neuro-fuzzy paradigmIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2001
- Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvementIEEE Transactions on Fuzzy Systems, 2000
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- Selecting fuzzy if-then rules for classification problems using genetic algorithmsIEEE Transactions on Fuzzy Systems, 1995