LED-based Photometric Stereo: Modeling, Calibration and Numerical Solution
Preprint
Abstract
We conduct a thorough study of photometric stereo under nearby point light source illumination, from modeling to numerical solution, through calibration. In the classical formulation of photometric stereo, the luminous fluxes are assumed to be directional, which is very difficult to achieve in practice. Rather, we use light-emitting diodes (LEDs) to illuminate the scene to reconstruct. Such point light sources are very convenient to use, yet they yield a more complex photometric stereo model which is arduous to solve. We first derive in a physically sound manner this model, and show how to calibrate its parameters. Then, we discuss two state-of-the-art numerical solutions. The first one alternatingly estimates the albedo and the normals, and then integrates the normals into a depth map. It is shown empirically to be independent from the initialization, but convergence of this sequential approach is not established. The second one directly recovers the depth, by formulating photometric stereo as a system of PDEs which are partially linearized using image ratios. Although the sequential approach is avoided, initialization matters a lot and convergence is not established either. Therefore, we introduce a provably convergent alternating reweighted least-squares scheme for solving the original system of PDEs, without resorting to image ratios for linearization. Finally, we extend this study to the case of RGB images.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Height from photometric ratio with model-based light source selectionComputer Vision and Image Understanding, 2016
- Realistic photometric stereo using partial differential irradiance equation ratiosComputers & Graphics, 2015
- A practical means for calibrating an LED-based photometric stereo systemOptics and Lasers in Engineering, 2015
- Uncalibrated flatfielding and illumination vector estimationfor photometric stereo face reconstructionMachine Vision and Applications, 2014
- An improved photometric stereo through distance estimation and light vector optimization from diffused maxima regionPattern Recognition Letters, 2013
- Difference sphere: An approach to near light source estimationComputer Vision and Image Understanding, 2009
- Resolving handwriting from background printing using photometric stereoPattern Recognition, 2003
- A simple strategy for calibrating the geometry of light sourcesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Generalization of the Lambertian model and implications for machine visionInternational Journal of Computer Vision, 1995
- A dual algorithm for the solution of nonlinear variational problems via finite element approximationComputers & Mathematics with Applications, 1976