A Joint Model for 2D and 3D Pose Estimation from a Single Image
Authors:
- Edgar Simo-SerraESEdgar Simo-Serra
- Ariadna QuattoniAQAriadna Quattoni
- Carme TorrasCTCarme Torras
- Francesc Moreno-NoguerFMFrancesc Moreno-Noguer
- 1 June 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3634-3641
Abstract
We introduce a novel approach to automatically recover 3D human pose from a single image. Most previous work follows a pipelined approach: initially, a set of 2D features such as edges, joints or silhouettes are detected in the image, and then these observations are used to infer the 3D pose. Solving these two problems separately may lead to erroneous 3D poses when the feature detector has performed poorly. In this paper, we address this issue by jointly solving both the 2D detection and the 3D inference problems. For this purpose, we propose a Bayesian framework that integrates a generative model based on latent variables and discriminative 2D part detectors based on HOGs, and perform inference using evolutionary algorithms. Real experimentation demonstrates competitive results, and the ability of our methodology to provide accurate 2D and 3D pose estimations even when the 2D detectors are inaccurate.Keywords
This publication has 21 references indexed in Scilit:
- Teaching 3D geometry to deformable part models2012
- Single image 3D human pose estimation from noisy observations2012
- Stochastic Exploration of Ambiguities for Nonrigid Shape RecoveryIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Reconstructing 3D Human Pose from 2D Image Landmarks2012
- Fast globally optimal 2D human detection with loopy graph models2010
- HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human MotionInternational Journal of Computer Vision, 2009
- Shared Kernel Information Embedding for discriminative inference2009
- Randomized trees for human pose detection2008
- Hierarchical Gaussian process latent variable models2007
- Generative modeling for continuous non-linearly embedded visual inference2004