What Shape Are Dolphins? Building 3D Morphable Models from 2D Images
- 6 March 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 35 (1) , 232-244
Abstract
3D morphable models are low-dimensional parameterizations of 3D object classes which provide a powerful means of associating 3D geometry to 2D images. However, morphable models are currently generated from 3D scans, so for general object classes such as animals they are economically and practically infeasible. We show that, given a small amount of user interaction (little more than that required to build a conventional morphable model), there is enough information in a collection of 2D pictures of certain object classes to generate a full 3D morphable model, even in the absence of surface texture. The key restriction is that the object class should not be strongly articulated, and that a very rough rigid model should be provided as an initial estimate of the “mean shape.” The model representation is a linear combination of subdivision surfaces, which we fit to image silhouettes and any identifiable key points using a novel combined continuous-discrete optimization strategy. Results are demonstrated on several natural object classes, and show that models of rather high quality can be obtained from this limited information.Keywords
This publication has 34 references indexed in Scilit:
- Finding nemo: Deformable object class modelling using curve matching2010
- Modeling from contour drawings2009
- Implicit Meshes for Effective Silhouette HandlingInternational Journal of Computer Vision, 2006
- Learning Class-Specific Edges for Object Detection and Segmentation2006
- The space of human body shapesACM Transactions on Graphics, 2003
- Motion from the frontier of curved surfaces2002
- Recovering non-rigid 3D shape from image streams2002
- A morphable model for the synthesis of 3D faces1999
- Model-based object pose in 25 lines of codeInternational Journal of Computer Vision, 1995
- Curve matching and stereo calibrationImage and Vision Computing, 1991