Stochastic Exploration of Ambiguities for Nonrigid Shape Recovery
Open Access
- 1 May 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 35 (2) , 463-475
Abstract
Recovering the 3D shape of deformable surfaces from single images is known to be a highly ambiguous problem because many different shapes may have very similar projections. This is commonly addressed by restricting the set of possible shapes to linear combinations of deformation modes and by imposing additional geometric constraints. Unfortunately, because image measurements are noisy, such constraints do not always guarantee that the correct shape will be recovered. To overcome this limitation, we introduce a stochastic sampling approach to efficiently explore the set of solutions of an objective function based on point correspondences. This allows us to propose a small set of ambiguous candidate 3D shapes and then use additional image information to choose the best one. As a proof of concept, we use either motion or shading cues to this end and show that we can handle a complex objective function without having to solve a difficult nonlinear minimization problem. The advantages of our method are demonstrated on a variety of problems including both real and synthetic data.Keywords
This publication has 36 references indexed in Scilit:
- Optimal Metric Projections for Deformable and Articulated Structure-from-MotionInternational Journal of Computer Vision, 2011
- Linear Local Models for Monocular Reconstruction of Deformable SurfacesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Capturing 3D stretchable surfaces from single images in closed form2009
- Monocular Template-based Reconstruction of Inextensible Surfaces2008
- Morphable 3D models from video2005
- Structure from Motion Using Sequential Monte Carlo MethodsInternational Journal of Computer Vision, 2004
- A finite element model for 3D shape reconstruction and nonrigid motion tracking2002
- Recovering non-rigid 3D shape from image streams2002
- Accurate Visual Metrology from Single and Multiple Uncalibrated Images2001
- Shape and nonrigid motion estimation through physics-based synthesisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993