Generalized Uncorrelated Regression with Adaptive Graph for Unsupervised Feature Selection
- 27 September 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 30 (5) , 1587-1595
Abstract
Unsupervised feature selection always occupies a key position as a preprocessing in the tasks of classification or clustering due to the existence of extra essential features within high-dimensional data. Although lots of efforts have been made, the existing methods neglect to consider the redundancy of features, and thus select redundant features. In this brief, by virtue of a generalized uncorrelated constraint, we present an improved sparse regression model [generalized uncorrelated regression model (GURM)] for seeking the uncorrelated yet discriminative features. Benefited from this, the structure of data is kept in the Stiefel manifold, which avoids the potential trivial solution triggered by a conventional ridge regression model. Besides that, the uncorrelated constraint equips the model with the closed-form solution. In addition, we also incorporate a graph regularization term based on the principle of maximum entropy into the GURM model (URAFS), so as to embed the local geometric structure of data into the manifold learning. An efficient algorithm is designed to perform URAFS by virtue of the existing generalized powered iteration method. Extensive experiments on eight benchmark data sets among seven state-of-the-art methods on the task of clustering are conducted to verify the effectiveness and superiority of the proposed method.Keywords
Funding Information
- National Basic Research Program of China (2018YFB1107400)
- National Natural Science Foundation of China (61761130079, 61772427, 61751202, 61871470)
This publication has 20 references indexed in Scilit:
- Representative Vector Machines: A Unified Framework for Classical ClassifiersIEEE Transactions on Cybernetics, 2015
- Robust Manifold Nonnegative Matrix FactorizationACM Transactions on Knowledge Discovery From Data, 2014
- An unsupervised feature selection algorithm based on ant colony optimizationEngineering Applications of Artificial Intelligence, 2014
- Group Sparse Multiview Patch Alignment Framework With View Consistency for Image ClassificationIEEE Transactions on Image Processing, 2014
- A novel method for recognizing face with partial occlusion via sparse representationOptik, 2013
- Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature SelectionIEEE Transactions on Cybernetics, 2013
- Face recognition via Weighted Sparse RepresentationJournal of Visual Communication and Image Representation, 2013
- Discriminant sparse neighborhood preserving embedding for face recognitionPattern Recognition, 2012
- A database for handwritten text recognition researchIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
- On a Theorem of Weyl Concerning Eigenvalues of Linear Transformations IProceedings of the National Academy of Sciences, 1949