Local Adaptive Projection Framework for Feature Selection of Labeled and Unlabeled Data
- 18 May 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 29 (12) , 6362-6373
Abstract
Most feature selection methods first compute a similarity matrix by assigning a fixed value to pairs of objects in the whole data or to pairs of objects in a class or by computing the similarity between two objects from the original data. The similarity matrix is fixed as a constant in the subsequent feature selection process. However, the similarities computed from the original data may be unreliable, because they are affected by noise features. Moreover, the local structure within classes cannot be recovered if the similarities between the pairs of objects in a class are equal. In this paper, we propose a novel local adaptive projection (LAP) framework. Instead of computing fixed similarities before performing feature selection, LAP simultaneously learns an adaptive similarity matrix S and a projection matrix W with an iterative method. In each iteration, S is computed from the projected distance with the learned W and W is computed with the learned S. Therefore, LAP can learn better projection matrix W by weakening the effect of noise features with the adaptive similarity matrix. A supervised feature selection with LAP (SLAP) method and an unsupervised feature selection with LAP (ULAP) method are proposed. Experimental results on eight data sets show the superiority of SLAP compared with seven supervised feature selection methods and the superiority of ULAP compared with five unsupervised feature selection methods.Keywords
Funding Information
- National Natural Science Foundation of China (61305059, 61773268, U1636202)
- Shenzhen University
This publication has 19 references indexed in Scilit:
- Robust Joint Graph Sparse Coding for Unsupervised Spectral Feature SelectionIEEE Transactions on Neural Networks and Learning Systems, 2016
- Feature Selection via Global Redundancy MinimizationIEEE Transactions on Knowledge and Data Engineering, 2015
- Supervised feature selection: A tutorialArtificial Intelligence Research, 2015
- Robust Spectral Learning for Unsupervised Feature Selection2014
- Semisupervised Feature Selection via Spline Regression for Video Semantic RecognitionIEEE Transactions on Neural Networks and Learning Systems, 2014
- High-Dimensional Feature Selection by Feature-Wise Kernelized LassoNeural Computation, 2014
- Discriminative Least Squares Regression for Multiclass Classification and Feature SelectionIEEE Transactions on Neural Networks and Learning Systems, 2012
- Semi-supervised Feature Selection via Spectral Analysis2007
- Graph Embedding and Extensions: A General Framework for Dimensionality ReductionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- A Practical Approach to Feature Selection1992