Robust regression using sparse learning for high dimensional parameter estimation problems
Authors:
- 1 January 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3846-3849
Abstract
Algorithms such as Least Median of Squares (LMedS) and Random Sample Consensus (RANSAC) have been very successful for low-dimensional robust regression problems. However, the combinatorial nature of these algorithms makes them practically unusable for high-dimensional applications. In this paper, we introduce algorithms that have cubic time complexity in the dimension of the problem, which make them computationally efficient for high-dimensional problems. We formulate the robust regression problem by projecting the dependent variable onto the null space of the independent variables which receives significant contributions only from the outliers. We then identify the outliers using sparse representation/learning based algorithms. Under certain conditions, that follow from the theory of sparse representation, these polynomial algorithms can accurately solve the robust regression problem which is, in general, a combinatorial problem. We present experimental results that demonstrate the efficacy of the proposed algorithms. We also analyze the intrinsic parameter space of robust regression and identify an efficient and accurate class of algorithms for different operating conditions. An application to facial age estimation is presented.Keywords
This publication has 9 references indexed in Scilit:
- Robust Tests2009
- Highly Robust Error Correction byConvex ProgrammingIEEE Transactions on Information Theory, 2008
- An Introduction To Compressive SamplingIEEE Signal Processing Magazine, 2008
- Stable recovery of sparse overcomplete representations in the presence of noiseIEEE Transactions on Information Theory, 2005
- Sparse Bayesian Learning for Basis SelectionIEEE Transactions on Signal Processing, 2004
- MLESAC: A New Robust Estimator with Application to Estimating Image GeometryComputer Vision and Image Understanding, 2000
- Robust Parameter Estimation in Computer VisionSIAM Review, 1999
- Atomic Decomposition by Basis PursuitSIAM Journal on Scientific Computing, 1998
- Random sample consensusCommunications of the ACM, 1981