Rigid Structure from Motion from a Blind Source Separation Perspective
- 18 December 2009
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Vision
- Vol. 88 (3) , 404-424
Abstract
We present an information theoretic approach to define the problem of structure from motion (SfM) as a blind source separation one. Given that for almost all practical joint densities of shape points, the marginal densities are non-Gaussian, we show how higher-order statistics can be used to provide improvements in shape estimates over the methods of factorization via Singular Value Decomposition (SVD), bundle adjustment and Bayesian approaches. Previous techniques have either explicitly or implicitly used only second-order statistics in models of shape or noise. A further advantage of viewing SfM as a blind source problem is that it easily allows for the inclusion of noise and shape models, resulting in Maximum Likelihood (ML) or Maximum a Posteriori (MAP) shape and motion estimates. A key result is that the blind source separation approach has the ability to recover the motion and shape matrices without the need to explicitly know the motion or shape pdf. We demonstrate that it suffices to know whether the pdf is sub- or super-Gaussian (i.e., semi-parametric estimation) and derive a simple formulation to determine this from the data. We provide extensive experimental results on synthetic and real tracked points in order to quantify the improvement obtained from this technique.Keywords
This publication has 22 references indexed in Scilit:
- Precise detailed detection of faces and facial features2008
- A Blind Source Separation Approach to Structure from Motion2006
- A Direct Method for 3D Factorization of Nonrigid Motion Observed in 2D2005
- Damped Newton Algorithms for Matrix Factorization with Missing Data2005
- Nonlinear PCA/ICA for the Structure from Motion Problem2004
- Identifiability, Separability, and Uniqueness of Linear ICA ModelsIEEE Signal Processing Letters, 2004
- Recovering the missing components in a large noisy low-rank matrix: application to SFMIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Bayesian structure from motion1999
- Robust techniques for independent component analysis (ICA) with noisy dataNeurocomputing, 1998
- A blind source separation technique using second-order statisticsIEEE Transactions on Signal Processing, 1997