A Novel Feature Selection Algorithm Using Multi-Objective Improved Honey Badger Algorithm and Strength Pareto Evolutionary Algorithm-II
Authors:
Open Access
- 7 June 2022
- journal article
- research article
- Published by Elsevier in Journal of Engineering Research
- Vol. 11 (2) , 71-83
Abstract
An important task for classification is feature selection that removes the redundant or irrelevant features from the dataset. Multi-objective feature selection approach is mainly proposed by many researches. However, these approaches fails to maintain the higher classification accuracy while removing redundancy in the features. In this work, a wrapper based feature selection technique is proposed with hybrid of Multi Objective Honey Badger Algorithm (MOHBA) and Strength Pareto Evolutionary Algorithm-II to maintain the balance between classification accuracy and removal of redundancy. Classification accuracy improvement and removal of redundant features are considered as the multi-objective optimization functions of the proposed multi-objective feature selection technique. The Levy flight algorithm is utilized to initialize the population to enhance the ability of the exploration and exploitation of MO-HBA. The regularized Extreme Learning Machine is used to classify the selected features. To evaluate the performance of the proposed feature selection technique, eighteen benchmark datasets are utilized and results are compared with the four well known multi-objective feature selection techniques in terms of accuracy, precision, recall, micro F1 score, hamming loss, ranking loss and training time. The experimental results shows that the proposed approach can give improved classification accuracy while the removal of redundancy in large scale datasets.Keywords
This publication has 33 references indexed in Scilit:
- Improved salp swarm algorithm based on the levy flight for feature selectionThe Journal of Supercomputing, 2021
- Multi-objective optimization of feature selection using hybrid cat swarm optimizationScience China Technological Sciences, 2020
- A multi-objective genetic algorithm for text feature selection using the relative discriminative criterionExpert Systems with Applications, 2020
- C-HMOSHSSA: Gene selection for cancer classification using multi-objective meta-heuristic and machine learning methodsComputer Methods and Programs in Biomedicine, 2019
- A multi-objective approach for profit-driven feature selection in credit scoringDecision Support Systems, 2019
- Optimizing multi-objective PSO based feature selection method using a feature elitism mechanismExpert Systems with Applications, 2018
- Multi-objective simplified swarm optimization with weighting scheme for gene selectionApplied Soft Computing, 2018
- A novel Hybrid Genetic Local Search Algorithm for feature selection and weighting with an application in strategic decision making in innovation managementInformation Sciences, 2017
- Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanismsApplied Soft Computing, 2014
- Hierarchical genetic algorithm with new evaluation function and bi-coded representation for the selection of features considering their confidence rateApplied Soft Computing, 2011