Fuzzy-LFS: A Novel Localized Feature Selection With Fuzzy Region Division and Local Neighborhood Rough Set for Classification
- 31 March 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 34 (6) , 1844-1858
Abstract
Localized feature selection (LFS) methods divide the whole sample space to determine region-specific subsets for classification which outperform traditional feature selection with a global feature subset for the entire sample space. However, existing LFS algorithms decompose the local regions by impurity level of samples, which can misplace critical samples and impair feature selection results. To tackle this issue, this paper proposes a novel Fuzzy Localized Feature Selection (Fuzzy-LFS) algorithm, which divides local regions around each sample based on Gaussian fuzzy membership to enhance the coherence of region-specific information. Besides, to handle data fuzziness and uncertainty, Fuzzy-LFS establishes a Local Neighborhood Rough Set Model with forward greedy optimization to search the feature subsets. A novel local classifier is subsequently developed, overcoming the limitations of global classifiers unsuited for LFS while mitigating the excessive dependency on impurity level in traditional local classifiers. Specifically, for high-dimensional datasets, we introduce a Localized Feature Relevance Pre-Selection strategy, assigning sample-specific feature subsets according to local relevance to assist in dividing local regions and enhance classification performance. Through comprehensive experiments on 11 low-dimensional and 13 high-dimensional datasets, Fuzzy-LFS achieves superior classification accuracy to state-of-the-art LFS methods, demonstrating its effectiveness.Keywords
Funding Information
- Basic and Applied Basic Research Foundation of Guangdong Province (2024A1515012485)
- National Natural Science Foundation of China (72271168)
- Guangdong Science and Technology Programme (2024B0101120003)
- Shenzhen Science and Technology (KJZD20230923114111021)
This publication has 47 references indexed in Scilit:
- Incremental feature selection: Parallel approach with local neighborhood rough sets and composite entropyPattern Recognition, 2024
- A new filter feature selection algorithm for classification task by ensembling pearson correlation coefficient and mutual informationEngineering Applications of Artificial Intelligence, 2024
- A novel relation aware wrapper method for feature selectionPattern Recognition, 2023
- Local feature selection based on artificial immune system for classificationApplied Soft Computing, 2020
- Local neighborhood rough setKnowledge-Based Systems, 2018
- Local rough set: A solution to rough data analysis in big dataInternational Journal of Approximate Reasoning, 2018
- Feature selection using Joint Mutual Information MaximisationExpert Systems with Applications, 2015
- Evidence-theory-based numerical algorithms of attribute reduction with neighborhood-covering rough setsInternational Journal of Approximate Reasoning, 2014
- A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithmsSwarm and Evolutionary Computation, 2011
- Neighborhood rough set based heterogeneous feature subset selectionInformation Sciences, 2008