Multiview Semi-Supervised Learning with Consensus
Authors:
- 29 July 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 24 (11) , 2040-2051
Abstract
Obtaining high-quality and up-to-date labeled data can be difficult in many real-world machine learning applications. Semi-supervised learning aims to improve the performance of a classifier trained with limited number of labeled data by utilizing the unlabeled ones. This paper demonstrates a way to improve the transductive SVM, which is an existing semi-supervised learning algorithm, by employing a multiview learning paradigm. Multiview learning is based on the fact that for some problems, there may exist multiple perspectives, so called views, of each data sample. For example, in text classification, the typical view contains a large number of raw content features such as term frequency, while a second view may contain a small but highly informative number of domain specific features. We propose a novel two-view transductive SVM that takes advantage of both the abundant amount of unlabeled data and their multiple representations to improve classification result. The idea is straightforward: train a classifier on each of the two views of both labeled and unlabeled data, and impose a global constraint requiring each classifier to assign the same class label to each labeled and unlabeled sample. We also incorporate manifold regularization, a kind of graph-based semi-supervised learning method into our framework. The proposed two-view transductive SVM was evaluated on both synthetic and real-life data sets. Experimental results show that our algorithm performs up to 10 percent better than a single-view learning approach, especially when the amount of labeled data is small. The other advantage of our two-view semi-supervised learning approach is its significantly improved stability, which is especially useful when dealing with noisy data in real-world applications.Keywords
This publication has 17 references indexed in Scilit:
- Two-view Transductive Support Vector Machines2010
- Complexity versus Agreement for Many Views2009
- Large scale manifold transduction2008
- An RKHS for multi-view learning and manifold co-regularization2008
- Synthesis of maximum margin and multiview learning using unlabeled dataNeurocomputing, 2007
- Efficient co-regularised least squares regression2006
- A continuation method for semi-supervised SVMs2006
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004
- Mining the peanut gallery2003
- Learning to remove Internet advertisements1999