Multilabel Feature Selection via Shared Latent Sublabel Structure and Simultaneous Orthogonal Basis Clustering
- 24 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (3) , 5288-5303
Abstract
Multilabel feature selection solves the dimension distress of high-dimensional multilabel data by selecting the optimal subset of features. Noisy and incomplete labels of raw multilabel data hinder the acquisition of label-guided information. In existing approaches, mapping the label space to a low-dimensional latent space by semantic decomposition to mitigate label noise is considered an effective strategy. However, the decomposed latent label space contains redundant label information, which misleads the capture of potential label relevance. To eliminate the effect of redundant information on the extraction of latent label correlations, a novel method named SLOFS via shared latent sublabel structure and simultaneous orthogonal basis clustering for multilabel feature selection is proposed. First, a latent orthogonal base structure shared (LOBSS) term is engineered to guide the construction of a redundancy-free latent sublabel space via the separated latent clustering center structure. The LOBSS term simultaneously retains latent sublabel information and latent clustering center structure. Moreover, the structure and relevance information of nonredundant latent sublabels are fully explored. The introduction of graph regularization ensures structural consistency in the data space and latent sublabels, thus helping the feature selection process. SLOFS employs a dynamic sublabel graph to obtain a high-quality sublabel space and uses regularization to constrain label correlations on dynamic sublabel projections. Finally, an effective convergence provable optimization scheme is proposed to solve the SLOFS method. The experimental studies on the 18 datasets demonstrate that the presented method performs consistently better than previous feature selection methods.Keywords
Funding Information
- National Natural Science Foundation of China (62176200, 12326617)
- Natural Science Basic Research Program of Shaanxi (2022JC-45, 2022JQ-616)
- Basic and Applied Basic Research Foundation of Guangdong Province (2021A1515110686)
- Higher Education Discipline Innovation Project
This publication has 49 references indexed in Scilit:
- Group-preserving label-specific feature selection for multi-label learningExpert Systems with Applications, 2022
- Orthogonally constrained matrix factorization for robust unsupervised feature selection with local preservingInformation Sciences, 2022
- Multi-label feature selection with constraint regression and adaptive spectral graphKnowledge-Based Systems, 2021
- MFS-MCDM: Multi-label feature selection using multi-criteria decision makingKnowledge-Based Systems, 2020
- Robust multi-label feature selection with dual-graph regularizationKnowledge-Based Systems, 2020
- Feature ranking for enhancing boosting-based multi-label text categorizationExpert Systems with Applications, 2018
- Online multi-label dependency topic models for text classificationMachine Learning, 2017
- A generalized power iteration method for solving quadratic problem on the Stiefel manifoldScience China Information Sciences, 2017
- Multi-label feature selection based on max-dependency and min-redundancyNeurocomputing, 2015
- Multilabel classification via calibrated label rankingMachine Learning, 2008