Reconstruction and Accurate Alignment of Feature Maps for Augmented Reality
Authors:
- 1 May 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15506185,p. 140-147
Abstract
This paper focuses on the preparative process of retrieving accurate feature maps for a camera-based tracking system. With this system it is possible to create ready-to use Augmented Reality applications with a very easy setup work-flow, which in practice only involves three steps: filming the object or environment from various viewpoints, defining a transformation between the reconstructed map and the target coordinate frame based on a small number of 3D-3D correspondences and, finally, initiating a feature learning and Bundle Adjustment step. Technically, the solution comprises several sub-algorithms. Given the image sequence provided by the user, a feature map is initially reconstructed and incrementally extended using a Simultaneous-Localization-and-Mapping (SLAM) approach. For the automatic initialization of the SLAM module, a method for detecting the amount of translation is proposed. Since the initially reconstructed map is defined in an arbitrary coordinate system, we present a method for optimally aligning the feature map to the target coordinated frame of the augmentation models based on 3D-3D correspondences defined by the user. As an initial estimate we solve for a rigid transformation with scaling, known as Absolute Orientation. For refinement of the alignment we present a modification of the well-known Bundle Adjustment, where we include these 3D-3D-correspondences as constraints. Compared to ordinary Bundle Adjustment we show that this leads to significantly more accurate reconstructions, since map deformations due to systematic errors such as small camera calibration errors or outliers are well compensated. This again results in a better alignment of the augmentations during run-time of the application, even in large-scale environments.Keywords
This publication has 13 references indexed in Scilit:
- SBAACM Transactions on Mathematical Software, 2009
- Measuring camera translation by the dominant apical angle2008
- Parallel Tracking and Mapping for Small AR Workspaces2007
- Extrinsic Camera Parameter Recovery from Multiple Image Sequences Captured by an Omni-Directional Multi-camera System2004
- Extendible tracking by line auto-calibration2002
- Dense 3-D Reconstruction of an Outdoor Scene by Hundreds-Baseline Stereo Using a Hand-Held Video CameraInternational Journal of Computer Vision, 2002
- In defense of the eight-point algorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Least-squares estimation of transformation parameters between two point patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- Least-Squares Fitting of Two 3-D Point SetsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1987
- Closed-form solution of absolute orientation using unit quaternionsJournal of the Optical Society of America A, 1987