MRM-Lasso: A Sparse Multiview Feature Selection Method via Low-Rank Analysis
Authors:
- 19 February 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 26 (11) , 2801-2815
Abstract
Learning about multiview data involves many applications, such as video understanding, image classification, and social media. However, when the data dimension increases dramatically, it is important but very challenging to remove redundant features in multiview feature selection. In this paper, we propose a novel feature selection algorithm, multiview rank minimization-based Lasso (MRM-Lasso), which jointly utilizes Lasso for sparse feature selection and rank minimization for learning relevant patterns across views. Instead of simply integrating multiple Lasso from view level, we focus on the performance of sample-level (sample significance) and introduce pattern-specific weights into MRM-Lasso. The weights are utilized to measure the contribution of each sample to the labels in the current view. In addition, the latent correlation across different views is successfully captured by learning a low-rank matrix consisting of pattern-specific weights. The alternating direction method of multipliers is applied to optimize the proposed MRM-Lasso. Experiments on four real-life data sets show that features selected by MRM-Lasso have better multiview classification performance than the baselines. Moreover, pattern-specific weights are demonstrated to be significant for learning about multiview data, compared with view-specific weights.Keywords
Funding Information
- National Science Foundation of China (61432008, 61305068, 61321491)
- Graduate Research Innovation Program of Jiangsu, China (CXZZ13_0055)
- Collaborative Innovation Center of Novel Software Technology and Industrialization
This publication has 29 references indexed in Scilit:
- Minimax Sparse Logistic Regression for Very High-Dimensional Feature SelectionIEEE Transactions on Neural Networks and Learning Systems, 2013
- Low-Rank Structure Learning via Nonconvex Heuristic RecoveryIEEE Transactions on Neural Networks and Learning Systems, 2013
- Multiview Metric Learning with Global Consistency and Local SmoothnessACM Transactions on Intelligent Systems and Technology, 2012
- L2-norm multiple kernel learning and its application to biomedical data fusionBMC Bioinformatics, 2010
- A Singular Value Thresholding Algorithm for Matrix CompletionSIAM Journal on Optimization, 2010
- Recovering time-varying networks of dependencies in social and biological studiesProceedings of the National Academy of Sciences, 2009
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Sparsity and Smoothness Via the Fused LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 2004
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- Selection of relevant features and examples in machine learningArtificial Intelligence, 1997