Model Estimation and Selection towardsUnconstrained Real-Time Tracking and Mapping
- 18 October 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 20 (6) , 825-838
Abstract
We present an approach and prototype implementation to initialization-free real-time tracking and mapping that supports any type of camera motion in 3D environments, that is, parallax-inducing as well as rotation-only motions. Our approach effectively behaves like a keyframe-based Simultaneous Localization and Mapping system or a panorama tracking and mapping system, depending on the camera movement. It seamlessly switches between the two modes and is thus able to track and map through arbitrary sequences of parallax-inducing and rotation-only camera movements. The system integrates both model-based and model-free tracking, automatically choosing between the two depending on the situation, and subsequently uses the “Geometric Robust Information Criterion” to decide whether the current camera motion can best be represented as a parallax-inducing motion or a rotation-only motion. It continues to collect and map data after tracking failure by creating separate tracks which are later merged if they are found to overlap. This is in contrast to most existing tracking and mapping systems, which suspend tracking and mapping and thus discard valuable data until relocalization with respect to the initial map is successful. We tested our prototype implementation on a variety of video sequences, successfully tracking through different camera motions and fully automatically building combinations of panoramas and 3D structure.Keywords
This publication has 37 references indexed in Scilit:
- Live tracking and mapping from both general and rotation-only camera motion2012
- Integrating the physical environment into mobile remote collaboration2012
- Homography-based planar mapping and tracking for mobile phones2011
- Rapid scene reconstruction on mobile phones from panoramic images2011
- Real-time monocular SLAM: Why filter?2010
- Photo tourismACM Transactions on Graphics, 2006
- 3D Models from Extended Uncalibrated Video Sequences: Addressing Key-Frame Selection and Projective Drift2005
- The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image SequencesInternational Journal of Computer Vision, 1999
- Modeling by shortest data descriptionAutomatica, 1978
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978