Dense mirroring surface recovery from 1D homographies and sparse correspondences
Authors:
- Stas RozenfeldSRStas Rozenfeld
- Ilan ShimshoniISIlan Shimshoni
- Michael LindenbaumMLMichael Lindenbaum
- 1 January 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1-8
Abstract
In this work we recover the 3D shape of mirroring objects such as mirrors, sunglasses, and stainless steel objects. A computer monitor displays several images of parallel stripes, each image at a different angle. Reflections of these stripes in a mirroring surface are captured by the camera. For every image point, the directions of the displayed stripes and their reflections in the image are related by a 1D homography which can be computed robustly and using the statistically accurate heteroscedastic model, without monitor-image correspondence, which is generally required by other techniques. Focusing on a small set of image points for which monitor-image correspondence is computed, the depth and the local shape may be calculated relying on this homography. This is done by an optimization process which is related to the one proposed by Savarese, Chen and Perona, but is different and more stable. Then dense surface recovery is performed using constrained interpolation, which does not simply interpolate the surface depth values, but rather solves for the depth, the correspondence, and the local surface shape, simultaneously at each interpolated point. Consistency with the ID homography is thus required. The proposed method as well as the method described in [A. Ripsman and M. Jenkin, IEEE Int. Symposium on Computational Intelligence (2001)] are inherently unstable on a small part of the surface. We propose a method to detect these instabilities and correct them. The method was implemented and the shapes of a mirror, sunglasses, and a stainless steel ashtray were recovered at sub-millimeter accuracy.Keywords
This publication has 11 references indexed in Scilit:
- Variational Surface Interpolation from Sparse Point and Normal DataIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Geometry From Specularities2005
- 3D acquisition of mirroring objects using striped patternsGraphical Models, 2005
- Local Shape from Mirror ReflectionsInternational Journal of Computer Vision, 2005
- Voxel carving for specular surfaces2003
- A theory of specular surface geometry2002
- Heteroscedastic Regression in Computer Vision: Problems with Bilinear ConstraintInternational Journal of Computer Vision, 2000
- Acquiring a complete 3D model from specular motion under the illumination of circular-shaped light sourcesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Structured light using pseudorandom codesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- The information available to a moving observer from specularitiesImage and Vision Computing, 1989