A new penalty-based wrapper fitness function for feature subset selection with evolutionary algorithms
Open Access
- 19 January 2018
- journal article
- research article
- Published by Taylor & Francis in Journal of Information and Telecommunication
- Vol. 2 (2) , 163-180
Abstract
Feature subset selection is an important preprocessing task for any real life data mining or pattern recognition problem. Evolutionary computational (EC) algorithms are popular as a search algorithm for feature subset selection. With the classification accuracy as the fitness function, the EC algorithms end up with feature subsets having considerably high recognition accuracy but the number of residual features also remain quite high. For high dimensional data, reduction of number of features is also very important to minimize computational cost of overall classification process. In this work, a wrapper fitness function composed of classification accuracy with another penalty term which penalizes for large number of features has been proposed. The proposed wrapper fitness function is used for feature subset evaluation and subsequent selection of optimal feature subset with several EC algorithms. The simulation experiments are done with several benchmark data sets having small to large number of features. The simulation results show that the proposed wrapper fitness function is efficient in reducing the number of features in the final selected feature subset without significant reduction of classification accuracy. The proposed fitness function has been shown to perform well for high-dimensional data sets with dimension up to 10,000.Keywords
This publication has 19 references indexed in Scilit:
- Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problemsNeural Computing and Applications, 2015
- Multi-Objective Feature Subset Selection using Non-dominated Sorting Genetic AlgorithmJournal of Applied Research and Technology, 2015
- Feature subset selection by gravitational search algorithm optimizationInformation Sciences, 2014
- A Binary Cuckoo Search and Its Application for Feature Selection2013
- BGSA: binary gravitational search algorithmNatural Computing, 2009
- GSA: A Gravitational Search AlgorithmInformation Sciences, 2009
- Hybrid genetic algorithms for feature selectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Feature selection with neural networksPattern Recognition Letters, 2002
- A fast and elitist multiobjective genetic algorithm: NSGA-IIIEEE Transactions on Evolutionary Computation, 2002
- Flocks, herds and schools: A distributed behavioral modelACM SIGGRAPH Computer Graphics, 1987