Simultaneous Multi-View Camera Pose Estimation and Object Tracking With Squared Planar Markers
Open Access
- 31 January 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 22927-22940
Abstract
Object tracking is a key aspect in many applications, such as augmented reality in medicine (e.g., tracking a surgical instrument) or robotics. Squared planar markers have become popular tools for tracking since their pose can be estimated from their four corners. While using a single marker and a single camera limits the working area considerably, using multiple markers attached to an object requires estimating their relative position, which is not trivial, for high-accuracy tracking. Likewise, using multiple cameras requires estimating their extrinsic parameters, also a tedious process that must be repeated whenever a camera is moved. This paper proposes a novel method to simultaneously solve the above-mentioned problems. From a video sequence showing a rigid set of planar markers recorded from multiple cameras, the proposed method is able to automatically obtain the three-dimensional configuration of the markers, the extrinsic parameters of the cameras, and the relative pose between the markers and the cameras at each frame. Our experiments show that our approach can obtain highly accurate results for estimating these parameters using the low-resolution cameras. Once the parameters are obtained, tracking of the object can be done in real time with a low computational cost. The proposed method is a step forward in the development of cost-effective solutions for object tracking.Keywords
All Related Versions
Funding Information
- Ministerio de Ciencia y Tecnología (IFI16/00033 (ISCIII), TIN2016-75279-P)
- FEDER
This publication has 33 references indexed in Scilit:
- Infinitesimal Plane-Based Pose EstimationInternational Journal of Computer Vision, 2014
- Automatic generation and detection of highly reliable fiducial markers under occlusionPattern Recognition, 2014
- Calibration of the Multi-camera Registration System for Visual Navigation BenchmarkingInternational Journal of Advanced Robotic Systems, 2014
- Augmented reality applications in design and manufacturingCIRP Annals, 2012
- Robotic manipulators and the product of exponentials formula2005
- A Convenient Multicamera Self-Calibration for Virtual EnvironmentsPRESENCE: Virtual and Augmented Reality, 2005
- The Studierstube Augmented Reality ProjectPRESENCE: Virtual and Augmented Reality, 2002
- Iterative Pose Estimation Using Coplanar Feature PointsComputer Vision and Image Understanding, 1996
- Circle fitting by linear and nonlinear least squaresJournal of Optimization Theory and Applications, 1993
- Closed-form solution of absolute orientation using unit quaternionsJournal of the Optical Society of America A, 1987