Online Coregularization for Multiview Semisupervised Learning
Open Access
- 1 January 2013
- journal article
- research article
- Published by Wiley in The Scientific World Journal
- Vol. 2013 (1) , 398146
Abstract
We propose a novel online coregularization framework for multiview semisupervised learning based on the notion of duality in constrained optimization. Using the weak duality theorem, we reduce the online coregularization to the task of increasing the dual function. We demonstrate that the existing online coregularization algorithms in previous work can be viewed as an approximation of our dual ascending process using gradient ascent. New algorithms are derived based on the idea of ascending the dual function more aggressively. For practical purpose, we also propose two sparse approximation approaches for kernel representation to reduce the computational complexity. Experiments show that our derived online coregularization algorithms achieve risk and accuracy comparable to offline algorithms while consuming less time and memory. Specially, our online coregularization algorithms are able to deal with concept drift and maintain a much smaller error rate. This paper paves a way to the design and analysis of online coregularization algorithms.Keywords
This publication has 12 references indexed in Scilit:
- Online Manifold Regularization by Dual Ascending ProcedureMathematical Problems in Engineering, 2013
- Online Co-regularized Algorithms2012
- A DESCRIPTIVE FRAMEWORK FOR THE FIELD OF DATA MINING AND KNOWLEDGE DISCOVERYInternational Journal of Information Technology & Decision Making, 2008
- Online Manifold Regularization: A New Learning Setting and Empirical StudyLecture Notes in Computer Science, 2008
- Synthesis of maximum margin and multiview learning using unlabeled dataNeurocomputing, 2007
- Sequential Karhunen-Loeve basis extraction and its application to imagesIEEE Transactions on Image Processing, 2000
- On-Line Algorithms in Machine Learning1998
- The Nature of Statistical Learning Theory1995
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988
- An algorithm for suffix strippingProgram: electronic library and information systems, 1980