Polarimetric Normal Stereo
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 682-690
Abstract
We introduce a novel method for recovering per-pixel surface normals from a pair of polarization cameras. Unlike past methods that use polarimetric observations as auxiliary features for correspondence matching, we fully integrate them in cost volume construction and filtering to directly recover per-pixel surface normals, not as byproducts of recovered disparities. Our key idea is to introduce a polarimetric cost volume of distance defined on the polarimetric observations and the polarization state computed from the surface normal. We adapt a belief propagation algorithm to filter this cost volume. The filtering algorithm simultaneously estimates the disparities and surface normals as separate entities, while effectively denoising the original noisy polarimetric observations of a quad-Bayer polarization camera. In addition, in contrast to past methods, we model polarimetric light reflection of mesoscopic surface roughness, which is essential to account for its illumination-dependency. We demonstrate the effectiveness of our method on a number of complex, real objects. Our method offers a simple and detailed 3D sensing capability for complex, non-Lambertian surfaces.Keywords
This publication has 17 references indexed in Scilit:
- Surface normal estimation of black specular objects from multiview polarization imagesOptical Engineering, 2016
- Polarized 3D: High-Quality Depth Sensing with Polarization Cues2015
- Single-Shot Reflectance Measurement from Polarized Color Gradient Illumination2015
- PatchMatch Stereo - Stereo Matching with Slanted Support Windows2011
- Accurate, Dense, and Robust Multiview StereopsisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Shape Estimation Using Polarization and Shading from Two ViewsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Recovery of surface orientation from diffuse polarizationIEEE Transactions on Image Processing, 2006
- Polarization-based inverse rendering from a single view2003
- Constraining object features using a polarization reflectance modelIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- Surface reflection: physical and geometrical perspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991