Lions and Tigers and Bears: Capturing Non-rigid, 3D, Articulated Shape from Images
Authors:
- Silvia ZuffiSZSilvia Zuffi
- Angjoo KanazawaAKAngjoo Kanazawa
- Michael J. BlackMBMichael J. Black
- 1 June 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3955-3963
Abstract
Animals are widespread in nature and the analysis of their shape and motion is important in many fields and industries. Modeling 3D animal shape, however, is difficult because the 3D scanning methods used to capture human shape are not applicable to wild animals or natural settings. Consequently, we propose a method to capture the detailed 3D shape of animals from images alone. The articulated and deformable nature of animals makes this problem extremely challenging, particularly in unconstrained environments with moving and uncalibrated cameras. To make this possible, we use a strong prior model of articulated animal shape that we fit to the image data. We then deform the animal shape in a canonical reference pose such that it matches image evidence when articulated and projected into multiple images. Our method extracts significantly more 3D shape detail than previous methods and is able to model new species, including the shape of an extinct animal, using only a few video frames. Additionally, the projected 3D shapes are accurate enough to facilitate the extraction of a realistic texture map from multiple frames.Keywords
This publication has 23 references indexed in Scilit:
- Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences2015
- SMPLACM Transactions on Graphics, 2015
- Markerless Motion Capture through Visual Hull, Articulated ICP and Subject Specific Model GenerationInternational Journal of Computer Vision, 2009
- A Statistical Model of Human Pose and Body ShapeComputer Graphics Forum, 2009
- Animating animal motion from still2008
- Performance capture from sparse multi-view videoACM Transactions on Graphics, 2008
- Photo tourismACM Transactions on Graphics, 2006
- SCAPEACM Transactions on Graphics, 2005
- Animal gaits from videoProceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation - SCA '04, 2004
- Laplacian smoothing and Delaunay triangulationsCommunications in Applied Numerical Methods, 1988