An evolutionary feature selection method based on probability-based initialized particle swarm optimization
Authors:
Preprint
- 17 November 2023
- preprint
- Published by Springer Nature in Research Square
Abstract
Feature selection is a common data preprocessing technique that aims to construct better models by selecting the most predictive features. Existing particle swarm optimization-based feature selection algorithms encounter two challenges when dealing with high-dimensional problems: easy to fall into local optimum and high computational cost. Therefore, this paper proposes an evolutionary dual-task feature selection method based on probability-based initialization particle swarm optimization (PPSO-EDT), which aims to find optimal solutions by transferring knowledge between two related tasks. Firstly, a probability-based initialization strategy is designed to accelerate population convergence by fully utilizing the correlation between labels and features. Secondly, a task generation strategy based on feature correlation was designed, which constructs the main task and auxiliary task by selecting feature subsets with highly correlated values and feature subsets without redundancy, respectively. Finally, an multi-task transfer mechanism is used to transfer knowledge and find optimal solutions. The results on 12 high-dimensional datasets indicate that the proposed method achieves high classification performance with a small feature subset in a relatively short amount of time.Keywords
All Related Versions
This publication has 58 references indexed in Scilit:
- Enhanced Harris Hawks optimization as a feature selection for the prediction of student performanceComputing, 2021
- A Review of Grey Wolf Optimizer-Based Feature Selection Methods for Classification2019
- Hybrid Binary Particle Swarm Optimization and Flower Pollination Algorithm Based on Rough Set Approach for Feature Selection Problem2019
- A filter-based bare-bone particle swarm optimization algorithm for unsupervised feature selectionApplied Intelligence, 2019
- Improved salp swarm algorithm based on particle swarm optimization for feature selectionJournal of Ambient Intelligence and Humanized Computing, 2018
- PSO with surrogate models for feature selection: static and dynamic clustering-based methodsMemetic Computing, 2018
- Recent advances in feature selection and its applicationsKnowledge and Information Systems, 2017
- New mechanism for archive maintenance in PSO-based multi-objective feature selectionSoft Computing, 2016
- A genetic algorithm-based method for feature subset selectionSoft Computing, 2007
- On characterizing the ?knee? of the Pareto curve based on Normal-Boundary IntersectionStructural and Multidisciplinary Optimization, 1999