Shape from Specular Flow
- 1 July 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 32 (11) , 2054-2070
Abstract
An image of a specular (mirror-like) object is nothing but a distorted reflection of its environment. When the environment is unknown, reconstructing shape from such an image can be very difficult. This reconstruction task can be made tractable when, instead of a single image, one observes relative motion between the specular object and its environment, and therefore, a motion field-or specular flow-in the image plane. In this paper, we study the shape from specular flow problem and show that observable specular flow is directly related to surface shape through a nonlinear partial differential equation. This equation has the key property of depending only on the relative motion of the environment while being independent of its content. We take first steps toward understanding and exploiting this PDE, and we examine its qualitative properties in relation to shape geometry. We analyze several cases in which the surface shape can be recovered in closed form, and we show that, under certain conditions, specular shape can be reconstructed when both the relative motion and the content of the environment are unknown. We discuss numerical issues related to the proposed reconstruction algorithms, and we validate our findings using both real and synthetic data.Keywords
This publication has 37 references indexed in Scilit:
- Shape from Specular Reflection and Optical FlowInternational Journal of Computer Vision, 2008
- Dense mirroring surface recovery from 1D homographies and sparse correspondences2007
- Geometry From Specularities2005
- 3D acquisition of mirroring objects using striped patternsGraphical Models, 2005
- Local Shape from Mirror ReflectionsInternational Journal of Computer Vision, 2005
- A theory of refractive and specular 3D shape by light-path triangulation2005
- Phase measuring deflectometry: a new approach to measure specular free-form surfaces2004
- A Theory of Specular Surface GeometryInternational Journal of Computer Vision, 1997
- The information available to a moving observer from specularitiesImage and Vision Computing, 1989
- Reflection and Refraction at a Random Moving Surface I Pattern and Paths of Specular PointsJournal of the Optical Society of America, 1960