Robust RVM regression using sparse outlier model
Open Access
- 1 June 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1887-1894
Abstract
Kernel regression techniques such as Relevance Vector Machine (RVM) regression, Support Vector Regression and Gaussian processes are widely used for solving many computer vision problems such as age, head pose, 3D human pose and lighting estimation. However, the presence of outliers in the training dataset makes the estimates from these regression techniques unreliable. In this paper, we propose robust versions of the RVM regression that can handle outliers in the training dataset. We decompose the noise term in the RVM formulation into a (sparse) outlier noise term and a Gaussian noise term. We then estimate the outlier noise along with the model parameters. We present two approaches for solving this estimation problem: (1) a Bayesian approach, which essentially follows the RVM framework and (2) an optimization approach based on Basis Pursuit Denoising. In the Bayesian approach, the robust RVM problem essentially becomes a bigger RVM problem with the advantage that it can be solved efficiently by a fast algorithm. Empirical evaluations, and real experiments on image de-noising and age estimation demonstrate the better performance of the robust RVM algorithms over that of the RVM reg ression.Keywords
This publication has 15 references indexed in Scilit:
- Head Pose Estimation in Computer Vision: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- An Introduction To Compressive SamplingIEEE Signal Processing Magazine, 2008
- Estimating Human Age by Manifold Analysis of Face Pictures and Regression on Aging Features2007
- Kernel Regression for Image Processing and ReconstructionIEEE Transactions on Image Processing, 2007
- Robust Kernel Regression for Restoration and Reconstruction of Images from Sparse Noisy Data2006
- Stable recovery of sparse overcomplete representations in the presence of noiseIEEE Transactions on Information Theory, 2005
- Variational inference for Student-t models: Robust Bayesian interpolation and generalised component analysisNeurocomputing, 2005
- Image denoising using scale mixtures of gaussians in the wavelet domainIEEE Transactions on Image Processing, 2003
- Toward automatic simulation of aging effects on face imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Atomic Decomposition by Basis PursuitSIAM Journal on Scientific Computing, 1998