Partially Shared Latent Factor Learning With Multiview Data
Authors:
- 28 July 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 26 (6) , 1233-1246
Abstract
Multiview representations reveal the fundamental attributes of the studied instances from different perspectives. Some common perspectives are reviewed by multiple views simultaneously, while some specific ones are reflected by individual views. That is, there are two kinds of properties embedded in the multiview data: 1) consistency and 2) complementarity. Different from most multiview learning approaches only focusing on either consistency or complementarity, this paper proposes a novel semisupervised multiview learning algorithm, called partially shared latent factor (PSLF) learning, which jointly exploits both consistent and complementary information among multiple views. In PSLF, a nonnegative matrix factorization (NMF)-based formulation is adopted to learn a compact and comprehensive partially shared latent representation, which is composed of common latent factors shared by multiple views and some specific latent factors to each view. With the learned representations of multiview data, we introduce a robust sparse regression model to predict the cluster labels of labeled data. By integrating the NMF-based model and the regression model, we obtain a unified formulation and propose a multiplicative-based alternative algorithm for optimization. In addition, PSLF can learn the weights of different views adaptively according to the reconstruction precisions of data matrices. Our experimental study indicates different multiview data that contains consistent and complementary information in different degrees. In addition, the encouraging results of the proposed algorithm are achieved in comparison with the state-of-the-art algorithms on real-world data sets.Keywords
Funding Information
- 973 Program (2010CB327905)
- National Natural Science Foundation of China (61272329, 61273034, 61070104)
This publication has 26 references indexed in Scilit:
- Heterogeneous Image Features Integration via Multi-modal Semi-supervised Learning Model2013
- Structure preserving non-negative matrix factorization for dimensionality reductionComputer Vision and Image Understanding, 2013
- Multi-View Clustering via Joint Nonnegative Matrix Factorization2013
- Learning frame relevance for video classification2011
- Constrained Nonnegative Matrix Factorization for Image RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Image annotation using multi-correlation probabilistic matrix factorization2010
- Multiple view semi-supervised dimensionality reductionPattern Recognition, 2010
- Relational learning via collective matrix factorization2008
- Non-negative matrix factorization for semi-supervised data clusteringKnowledge and Information Systems, 2008
- On multi-view active learning and the combination with semi-supervised learning2008