3D pose refinement from reflections
Open Access
- 1 June 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1-8
Abstract
We demonstrate how to exploit reflections for accurate registration of shiny objects: The lighting environment can be retrieved from the reflections under a distant illumination assumption. Since it remains unchanged when the camera or the object of interest moves, this provides powerful additional constraints that can be incorporated into standard pose estimation algorithms. The key idea and main contribution of the paper is therefore to show that the registration should also be performed in the lighting environment space, instead of in the image space only. This lets us recover very accurate pose estimates because the specularities are very sensitive to pose changes. An interesting side result is an accurate estimate of the lighting environment. Furthermore, since the mapping from lighting environment to specularities has no analytical expression for objects represented as 3D meshes, and is not 1-to-1, registering lighting environments is far from trivial. However we propose a general and effective solution. Our approach is demonstrated on both synthetic and real images.Keywords
This publication has 19 references indexed in Scilit:
- Specular Flow and the Recovery of Surface Structure2006
- Monocular Model-Based 3D Tracking of Rigid Objects: A SurveyFoundations and Trends in Computer Graphics and Vision, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Eyes for relightingACM Transactions on Graphics, 2004
- Image-based reconstruction of spatial appearance and geometric detailACM Transactions on Graphics, 2003
- Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis2002
- A simple strategy for calibrating the geometry of light sourcesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Acquiring a radiance distribution to superimpose virtual objects onto a real sceneIEEE Transactions on Visualization and Computer Graphics, 1999
- Separation of Reflection Components Using Color and PolarizationInternational Journal of Computer Vision, 1997
- Light field rendering1996