Monocular Model-Based 3D Tracking of Rigid Objects: A Survey
Top Cited Papers
- 10 December 2005
- journal article
- Published by Emerald Publishing in Foundations and Trends in Computer Graphics and Vision
- Vol. 1 (1) , 1-89
Abstract
Many applications require tracking of complex 3D objects. These include visual servoing of robotic arms on specific target objects, Augmented Reality systems that require real-time registration of the object to be augmented, and head tracking systems that sophisticated interfaces can use. Computer Vision offers solutions that are cheap, practical and non-invasive. This survey reviews the different techniques and approaches that have been developed by industry and research. First, important mathematical tools are introduced: Camera representation, robust estimation and uncertainty estimation. Then a comprehensive study is given of the numerous approaches developed by the Augmented Reality and Robotics communities, beginning with those that are based on point or planar fiducial marks and moving on to those that avoid the need to engineer the environment by relying on natural features such as edges, texture or interest. Recent advances that avoid manual initialization and failures due to fast motion are also presented. The survery concludes with the different possible choices that should be made when implementing a 3D tracking system and a discussion of the future of vision-based 3D tracking. Because it encompasses many computer vision techniques from low-level vision to 3D geometry and includes a comprehensive study of the massive literature on the subject, this survey should be the handbook of the student, the researcher, or the engineer who wants to implement a 3D tracking system.Keywords
This publication has 82 references indexed in Scilit:
- Sequential Monte Carlo Methods in Practice2001
- Bundle Adjustment — A Modern Synthesis2000
- Active Contours1998
- Iterative Pose Estimation Using Coplanar Feature PointsComputer Vision and Image Understanding, 1996
- Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least SquaresJournal of Visual Communication and Image Representation, 1994
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992
- Robust model-based motion tracking through the integration of search and estimationInternational Journal of Computer Vision, 1992
- Feature extraction from faces using deformable templatesInternational Journal of Computer Vision, 1992
- Visual tracking of known three-dimensional objectsInternational Journal of Computer Vision, 1992
- Robust Statistics1981