Reconstructing scenes with mirror and glass surfaces
Authors:
Open Access
- 30 July 2018
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 37 (4) , 1-11
Abstract
Planar reflective surfaces such as glass and mirrors are notoriously hard to reconstruct for most current 3D scanning techniques. When treated naïvely, they introduce duplicate scene structures, effectively destroying the reconstruction altogether. Our key insight is that an easy to identify structure attached to the scanner---in our case an AprilTag---can yield reliable information about the existence and the geometry of glass and mirror surfaces in a scene. We introduce a fully automatic pipeline that allows us to reconstruct the geometry and extent of planar glass and mirror surfaces while being able to distinguish between the two. Furthermore, our system can automatically segment observations of multiple reflective surfaces in a scene based on their estimated planes and locations. In the proposed setup, minimal additional hardware is needed to create high-quality results. We demonstrate this using reconstructions of several scenes with a variety of real mirrors and glass.Keywords
This publication has 29 references indexed in Scilit:
- Mirror Surface Reconstruction from a Single ImageIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Real-time 3D reconstruction at scale using voxel hashingACM Transactions on Graphics, 2013
- Reconstructing Reflective and Transparent Surfaces from Epipolar Plane Images2013
- Image-based rendering for scenes with reflectionsACM Transactions on Graphics, 2012
- Transparent and Specular Object ReconstructionComputer Graphics Forum, 2010
- 3D acquisition of mirroring objects using striped patternsGraphical Models, 2005
- Transparent surface modeling from a pair of polarization imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- A survey of image registration techniquesACM Computing Surveys, 1992
- Marching cubes: A high resolution 3D surface construction algorithmACM SIGGRAPH Computer Graphics, 1987