4-sensor camera calibration for image representation invariant to shading, shadows, lighting, and specularities
Authors:
- M.S. DrewMDM.S. Drew
- 1 July 2001
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 473-480
Abstract
Most lighting can be accurately modeled using a simplified Planckian function. If we form logarithms of color ratios of camera sensor values, then in a Lambertian plus specular two-lobe model of reflection the temperature-dependent term is separate and is seen as a straight line: i.e., changing lighting amounts to changing each pixel value in a straight line, for a given camera. Here we use a 4-sensor camera. In this case, forming color ratios reduces the dimensionality to 3. Applying logarithms and projecting onto the plane in the 3D color space orthogonal to the light-change direction results in an image representation that is invariant to illumination change. For a given camera, the position of the specular point in the 2D plane is always the same, independent of the lighting. Thus a camera calibration produces illumination invariance at a single pixel. In the plane, matte surfaces reduce to points and specularities are almost straight lines. Extending each pixel value back to the matte position, postulated to be the maximum radius from the fixed specular point, at any angle in the 2D plane, removes specularity. Thus images are independent of shading (by forming ratios), independent of shadows (by making them independent of illumination temperature) and independent of specularities. The method is examined by forming 4D images from hyperspectral images, using real camera sensors, with encouraging resultKeywords
This publication has 9 references indexed in Scilit:
- A chromaticity space for specularity, illumination color- and illumination pose-invariant 3-D object recognition2002
- Classifying color transitions into shadow-geometry, illumination, highlight or material edges2002
- Estimation of diffuse and specular appearance1999
- Color and luminance information in natural scenesJournal of the Optical Society of America A, 1998
- A Framework for the Construction of Reflectance Maps for Machine VisionComputer Vision and Image Understanding, 1993
- Method for computing the scene-illuminant chromaticity from specular highlightsJournal of the Optical Society of America A, 1986
- Using color to separate reflection componentsColor Research & Application, 1985
- Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometryComputer Graphics and Image Processing, 1982
- Theory for Off-Specular Reflection From Roughened Surfaces*Journal of the Optical Society of America, 1967