A Particle Swarm Optimizer with Biased Exploration and Exploitation for High-Dimensional Optimization and Feature Selection
- 29 November 2024
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in Unmanned Systems
- Vol. 14 (01) , 95-117
Abstract
Autonomous intelligent systems have been widely implemented in a broad range of applications. These applications often involve data-dense tasks where an efficient feature selection process is required to eliminate redundant features and improve model performance. However, the feature selection tasks with high dimensionality still remain challenging to deal with. In order to address high-dimensional feature selection problems with greater effectiveness and efficiency, this paper proposes a particle swarm optimizer variant named PSO-BEE that allows the swarm to take full advantage of exploration and exploitation at due evolutionary stages. At the early stage, a large size of candidate exemplar group is formed for diversity enhancement, attempting to find as many new combinations of features as possible. At the later stage, a tiny size of candidate exemplar group is constructed, allowing updated particles to learn from the few best elite exemplars to continuously refine feature selection solutions with a lower classification error rate. Three PSO-BEE variants with distinct preferences for exploration and exploitation are proposed based on different parameter adjustment strategies. Experiments are executed on 500, 1000, and 2000-dimensional benchmark suites presented by CEC and real-world feature selection datasets from the Machine Learning Repository. Experimental results demonstrate the competitive performance of PSO-BEE in high-dimensional global optimization and feature selection when compared with several state-of-the-art approaches.Keywords
This publication has 37 references indexed in Scilit:
- A feature-thresholds guided genetic algorithm based on a multi-objective feature scoring method for high-dimensional feature selectionApplied Soft Computing, 2023
- An improved African vultures optimization algorithm using different fitness functions for multi-level thresholding image segmentationMultimedia Tools and Applications, 2023
- An enhanced binary artificial rabbits optimization for feature selection in medical diagnosisNeural Computing and Applications, 2023
- Random following ant colony optimization: Continuous and binary variants for global optimization and feature selectionApplied Soft Computing, 2023
- An enhanced binary Rat Swarm Optimizer based on local-best concepts of PSO and collaborative crossover operators for feature selectionComputers in Biology and Medicine, 2022
- Binary Horse herd optimization algorithm with crossover operators for feature selectionComputers in Biology and Medicine, 2022
- Chaotic-based divide-and-conquer feature selection method and its application in cardiac arrhythmia classificationThe Journal of Supercomputing, 2021
- LSHADE-SPA memetic framework for solving large-scale optimization problemsComplex & Intelligent Systems, 2018
- Large Scale Problems in Practice: The Effect of Dimensionality on the Interaction Among Variables2017
- Feature selection for high-dimensional classification using a competitive swarm optimizerSoft Computing, 2016