Subpixel Photometric Stereo
Authors:
- Ping TanPTPing Tan
- Stephen LinSLStephen Lin
- Long QuanLQLong Quan
- 20 June 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 30 (8) , 1460-1471
Abstract
Conventional photometric stereo recovers one normal direction per pixel of the input image. This fundamentally limits the scale of recovered geometry to the resolution of the input image, and cannot model surfaces with subpixel geometric structures. In this paper, we propose a method to recover subpixel surface geometry by studying the relationship between the subpixel geometry and the reflectance properties of a surface. We first describe a generalized physically-based reflectance model that relates the distribution of surface normals inside each pixel area to its reflectance function. The distribution of surface normals can be computed from the reflectance functions recorded in photometric stereo images. A convexity measure of subpixel geometry structure is also recovered at each pixel, through an analysis of the shadowing attenuation. Then, we use the recovered distribution of surface normals and the surface convexity to infer subpixel geometric structures on a surface of homogeneous material by spatially arranging the normals among pixels at a higher resolution than that of the input image. Finally, we optimize the arrangement of normals using a combination of belief propagation and MCMC based on a minimum description length criterion on 3D textons over the surface. The experiments demonstrate the validity of our approach and show superior geometric resolution for the recovered surfaces.Keywords
This publication has 24 references indexed in Scilit:
- Extracting the shape and roughness of specular lobe objects using four light photometric stereoIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Predicting reflectance functions from complex surfacesACM SIGGRAPH Computer Graphics, 1992
- Improving resolution by image registrationCVGIP: Graphical Models and Image Processing, 1991
- A theory of photometric stereo for a class of diffuse non-Lambertian surfacesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- Height and gradient from shadingInternational Journal of Computer Vision, 1990
- A method for enforcing integrability in shape from shading algorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1988
- A Universal Prior for Integers and Estimation by Minimum Description LengthThe Annals of Statistics, 1983
- Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometryComputer Graphics and Image Processing, 1982
- Numerical shape from shading and occluding boundariesArtificial Intelligence, 1981
- Theory for Off-Specular Reflection From Roughened Surfaces*Journal of the Optical Society of America, 1967