Feature-Selected Tree-Based Classification
- 19 February 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 43 (6) , 1990-2004
Abstract
Feature selection can decrease classifier size and improve accuracy by removing noisy and/or redundant features. However, it is possible for feature selection to yield features that are only partially informative about the classes in the set. These features are beneficial for distinguishing between some classes but not others. In these cases, it is beneficial to divide the large classification problem into a set of smaller problems, where a more specific set of features can be used to classify different classes. Dividing a problem this way is also common when the base classifier is binary, and the problem needs to be reformulated as a set of two-class problems so it can be handled by the classifier. This paper presents a method for multiclass classification that simultaneously formulates a binary tree of simpler classification subproblems and performs feature selection for the individual classifiers. The feature selected hierarchical classifier (FSHC) is tested against several well-known techniques for multiclass division. Tests are run on nine different real data sets and one artificial data set using a support vector machine (SVM) classifier. The results show that the accuracy obtained by the FSHC is comparable with other common multiclass SVM methods. Furthermore, the results demonstrate that the algorithm creates solutions with fewer classifiers, fewer features, and a shorter testing time than the other SVM multiclass extensions.Keywords
This publication has 29 references indexed in Scilit:
- Improved binary particle swarm optimization using catfish effect for feature selectionExpert Systems with Applications, 2011
- Feature subset selection in large dimensionality domainsPattern Recognition, 2010
- Adaptive binary tree for fast SVM multiclass classificationNeurocomputing, 2009
- Feature selection algorithms in classification problems: an experimental evaluationOptimization Methods and Software, 2007
- A genetic algorithm for solving the inverse problem of support vector machinesNeurocomputing, 2005
- OFFSS: optimal fuzzy-valued feature subset selectionIEEE Transactions on Fuzzy Systems, 2003
- A comparison of methods for multiclass support vector machinesIEEE Transactions on Neural Networks, 2002
- Comparison of algorithms that select features for pattern classifiersPattern Recognition, 2000
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- Floating search methods in feature selectionPattern Recognition Letters, 1994