Graph Representation Learning Enhanced Semi-Supervised Feature Selection
Open Access
- 12 November 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 18 (9) , 1-20
Abstract
Feature selection is a key step in machine learning by eliminating features that are not related to the modeling target to create reliable and interpretable models. By exploring the potential complex correlations among features of unlabeled data, recently introduced self-supervision-enhanced feature selection greatly reduces the reliance on the labeled samples. However, they are generally based on the autoencoder with sample-wise self-supervision, which can hardly exploit the relations among samples. To address this limitation, this article proposes graph representation learning enhanced semi-supervised feature selection (G-FS) which performs feature selection based on the discovery and exploitation of the non-Euclidean relations among features and samples by translating unlabeled “plain” tabular data into a bipartite graph. A self-supervised edge prediction task is designed to distill rich information on the graph into low-dimensional embeddings, which remove redundant features and noise. Guided by the condensed graph representation, we propose a batch attention feature weight generation mechanism that generates more robust weights according to batch-based selection patterns rather than individual samples. The results show that G-FS achieves significant performance edges in 14 datasets compared to twelve state-of-the-art baselines, including two recent self-supervised baselines. The source code is public available at https://github.com/Icannotnamemyselff/G-FS_Graph_enhacned_feature_selection .Keywords
Funding Information
- National Science Foundation of China (61772473, 62073345, and 62011530148)
This publication has 34 references indexed in Scilit:
- Hessian-based semi-supervised feature selection using generalized uncorrelated constraintKnowledge-Based Systems, 2023
- Adaptive graph learning for semi-supervised feature selection with redundancy minimizationInformation Sciences, 2022
- Semi-supervised feature selection via adaptive structure learning and constrained graph learningKnowledge-Based Systems, 2022
- Supervised feature selection through Deep Neural Networks with pairwise connected structureKnowledge-Based Systems, 2020
- A robust graph-based semi-supervised sparse feature selection methodInformation Sciences, 2020
- GMDH-based semi-supervised feature selection for customer classificationKnowledge-Based Systems, 2017
- Simple strategies for semi-supervised feature selectionMachine Learning, 2017
- A Survey on semi-supervised feature selection methodsPattern Recognition, 2017
- Deep Feature Selection: Theory and Application to Identify Enhancers and PromotersJournal of Computational Biology, 2016
- Semi-supervised SVM-based Feature Selection for Cancer Classification using Microarray Gene Expression Data2015