Specular Flow and the Recovery of Surface Structure
Authors:
- 10 July 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1869-1876
Abstract
In scenes containing specular objects, the image motion observed by a moving camera may be an intermixed combination of optical flow resulting from diffuse reflectance (diffuse flow) and specular reflection (specular flow). Here, with few assumptions, we formalize the notion of specular flow, show how it relates to the 3D structure of the world, and develop an algorithm for estimating scene structure from 2D image motion. Unlike previous work on isolated specular highlights we use two image frames and estimate the semi-dense flow arising from the specular reflections of textured scenes. We parametrically model the image motion of a quadratic surface patch viewed from a moving camera. The flow is modeled as a probabilistic mixture of diffuse and specular components and the 3D shape is recovered using an Expectation-Maximization algorithm. Rather than treating specular reflections as noise to be removed or ignored, we show that the specular flow provides additional constraints on scene geometry that improve estimation of 3D structure when compared with reconstruction from diffuse flow alone. We demonstrate this for a set of synthetic and real sequences of mixed specular-diffuse objects.Keywords
This publication has 22 references indexed in Scilit:
- Local analysis for 3D reconstruction of specular surfaces2005
- Specular Flow and the Perception of Surface ReflectanceJournal of Vision, 2003
- Determining shape and reflectance of Lambertian, specular, and hybrid surfaces using extended sources2003
- Principle of superposition: a common computational framework for analysis of multiple motion2002
- Reflections on Reflection in a Spherical MirrorThe American Mathematical Monthly, 1998
- A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants1998
- A Theory of Specular Surface GeometryInternational Journal of Computer Vision, 1997
- Compact representations of videos through dominant and multiple motion estimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Local shape from specularityComputer Vision, Graphics, and Image Processing, 1988
- Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo MethodIEEE Transactions on Pattern Analysis and Machine Intelligence, 1981