Color map optimization for 3D reconstruction with consumer depth cameras
Authors:
Top Cited Papers
Open Access
- 27 July 2014
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 33 (4) , 1-10
Abstract
We present a global optimization approach for mapping color images onto geometric reconstructions. Range and color videos produced by consumer-grade RGB-D cameras suffer from noise and optical distortions, which impede accurate mapping of the acquired color data to the reconstructed geometry. Our approach addresses these sources of error by optimizing camera poses in tandem with non-rigid correction functions for all images. All parameters are optimized jointly to maximize the photometric consistency of the reconstructed mapping. We show that this optimization can be performed efficiently by an alternating optimization algorithm that interleaves analytical updates of the color map with decoupled parameter updates for all images. Experimental results demonstrate that our approach substantially improves color mapping fidelity.Keywords
This publication has 43 references indexed in Scilit:
- A systematic approach for 2D-image to 3D-range registration in urban environmentsComputer Vision and Image Understanding, 2012
- Image‐to‐Geometry Registration: a Mutual Information Method exploiting Illumination‐related Geometric PropertiesComputer Graphics Forum, 2009
- Principles of Appearance Acquisition and RepresentationFoundations and Trends in Computer Graphics and Vision, 2009
- Interactive 3D architectural modeling from unordered photo collectionsACM Transactions on Graphics, 2008
- Geometry and Texture Recovery of Scenes of Large ScaleComputer Vision and Image Understanding, 2002
- A Silhouette-Based Algorithm for Texture Registration and StitchingGraphical Models, 2001
- High-quality texture reconstruction from multiple scansIEEE Transactions on Visualization and Computer Graphics, 2001
- Texturing 3D Models of Real World Objects from Multiple Unregistered Photographic ViewsComputer Graphics Forum, 1999
- The simplest subdivision scheme for smoothing polyhedraACM Transactions on Graphics, 1997
- Multiresolution textures from image sequencesIEEE Computer Graphics and Applications, 1997