Multi-view Reconstruction of Highly Specular Surfaces in Uncontrolled Environments
Authors:
- Clement GodardCGClement Godard
- Peter HedmanPHPeter Hedman
- Wenbin LiWLWenbin Li
- Gabriel J. BrostowGBGabriel J. Brostow
- 1 October 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 19-27
Abstract
Reconstructing the surface of highly specular objects is a challenging task. The shapes of diffuse and rough specular objects can be captured in an uncontrolled setting using consumer equipment. In contrast, highly specular objects have previously deterred capture in uncontrolled environments and have only been reconstructed using tailor-made hardware. We propose a method to reconstruct such objects in uncontrolled environments using only commodity hardware. As input, our method expects multi-view photographs of the specular object, its silhouettes and an environment map of its surroundings. We compare the reflected colors in the photographs with the ones in the environment to form probability distributions over the surface normals. As the effect of inter-reflections cannot be ignored for highly specular objects, we explicitly model them when forming the probability distributions. We recover the shape of the object in an iterative process where we alternate between estimating normals and updating the shape of the object to better explain these normals. We run experiments on both synthetic and real-world data, that show our method is robust and produces accurate reconstructions with as few as 25 input photographs.Keywords
This publication has 36 references indexed in Scilit:
- Acquiring reflectance and shape from continuous spherical harmonic illuminationACM Transactions on Graphics, 2013
- Shape from specular flow: Is one flow enough?2011
- Recovering shape from a single image of a mirrored surface from curvature constraints2011
- Image Invariants for Smooth Reflective Surfaces2010
- Heightfield and spatially varying BRDF Reconstruction for Materials with InterreflectionsComputer Graphics Forum, 2009
- Specular Flow and the Recovery of Surface Structure2006
- Local Shape from Mirror ReflectionsInternational Journal of Computer Vision, 2005
- What do reflections tell us about the shape of a mirror?2004
- Recovering Local Shape of a Mirror Surface from Reflection of a Regular Grid2004
- Retrieving shape information from multiple images of a specular surfaceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994