Multiple Graph Label Propagation by Sparse Integration
- 23 July 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 24 (12) , 1999-2012
Abstract
Graph-based approaches have been most successful in semisupervised learning. In this paper, we focus on label propagation in graph-based semisupervised learning. One essential point of label propagation is that the performance is heavily affected by incorporating underlying manifold of given data into the input graph. The other more important point is that in many recent real-world applications, the same instances are represented by multiple heterogeneous data sources. A key challenge under this setting is to integrate different data representations automatically to achieve better predictive performance. In this paper, we address the issue of obtaining the optimal linear combination of multiple different graphs under the label propagation setting. For this problem, we propose a new formulation with the sparsity (in coefficients of graph combination) property which cannot be rightly achieved by any other existing methods. This unique feature provides two important advantages: 1) the improvement of prediction performance by eliminating irrelevant or noisy graphs and 2) the interpretability of results, i.e., easily identifying informative graphs on classification. We propose efficient optimization algorithms for the proposed approach, by which clear interpretations of the mechanism for sparsity is provided. Through various synthetic and two real-world data sets, we empirically demonstrate the advantages of our proposed approach not only in prediction performance but also in graph selection ability.Keywords
This publication has 29 references indexed in Scilit:
- Semisupervised Classification With Cluster RegularizationIEEE Transactions on Neural Networks and Learning Systems, 2012
- New Semi-Supervised Classification Method Based on Modified Cluster AssumptionIEEE Transactions on Neural Networks and Learning Systems, 2012
- Semi-Supervised Dimension Reduction Using Trace Ratio CriterionIEEE Transactions on Neural Networks and Learning Systems, 2012
- On Propagated Scoring for Semisupervised Additive ModelsJournal of the American Statistical Association, 2011
- On multi-view learning with additive modelsThe Annals of Applied Statistics, 2009
- GeneMANIA: a real-time multiple association network integration algorithm for predicting gene functionGenome Biology, 2008
- Spectral clustering and transductive learning with multiple views2007
- Self-taught learning2007
- Efficient co-regularised least squares regression2006
- Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems2004