Kinectrack: 3D Pose Estimation Using a Projected Dense Dot Pattern
Authors:
- 1 June 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 20 (6) , 839-851
Abstract
Kinectrack is a novel approach to six-DoF tracking that provides agile real-time pose estimation using only commodity hardware. The dot pattern emitter and IR camera components of the standard Kinect device are separated to allow the emitter to roam freely relative to a fixed camera. The six-DoF pose of the emitter component is recovered by matching the dense dot pattern observed by the camera to a pre-captured reference image. A novel matching technique is introduced to obtain the dense dot pattern correspondences efficiently in wide- and adaptive-baseline scenarios that requires only a small subset of the full dense dot pattern to fall within the field of view of the fixed camera. An auto-calibration process is proposed in order to obtain the intrinsic parameters of the fixed camera and the internal dot pattern reference image of the emitter. The system simultaneously recovers the six-DoF pose of the emitter device and the piecewise planar 3D scene structure. Kinectrack provides a low-cost method for tracking an object without any on-board computation, with small size and only simple electronics. This paper extends the original ISMAR 2012 submission, including a demonstration of robust pose tracking for AR and examples of matching in planar and non-planar scenes.Keywords
This publication has 33 references indexed in Scilit:
- SideBySide2011
- Motion capture from body-mounted cameras2011
- ASTROMETRY.NET: BLIND ASTROMETRIC CALIBRATION OF ARBITRARY ASTRONOMICAL IMAGESThe Astronomical Journal, 2010
- Use of Affine Invariants in Locally Likely Arrangement Hashing for Camera-Based Document Image Retrieval2006
- A practical system for laser pointer interaction on large displays2005
- The optical tweezers2003
- Markerless tracking using planar structures in the scene2002
- Lumipoint: multi-user laser-based interaction on large tiled displaysDisplays, 2002
- Interacting with the big screen2002
- A Video Based Tracker for use in Computer Aided Surgery1994