Steady-State Non-Line-Of-Sight Imaging
Authors:
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 6783-6792
Abstract
Conventional intensity cameras recover objects in the direct line-of-sight of the camera, whereas occluded scene parts are considered lost in this process. Non-line-of-sight imaging (NLOS) aims at recovering these occluded objects by analyzing their indirect reflections on visible scene surfaces. Existing NLOS methods temporally probe the indirect light transport to unmix light paths based on their travel time, which mandates specialized instrumentation that suffers from low photon efficiency, high cost, and mechanical scanning. We depart from temporal probing and demonstrate steady-state NLOS imaging using conventional intensity sensors and continuous illumination. Instead of assuming perfectly isotropic scattering, the proposed method exploits directionality in the hidden surface reflectance, resulting in (small) spatial variation of their indirect reflections for varying illumination. To tackle the shape-dependence of these variations, we propose a trainable architecture which learns to map diffuse indirect reflections to scene reflectance using only synthetic training data. Relying on consumer color image sensors, with high fill factor, high quantum efficiency and low read-out noise, we demonstrate high-fidelity color NLOS imaging for scene configurations tackled before with picosecond time resolution.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Looking around corners and through thin turbid layers in real time with scattered incoherent lightNature Photonics, 2012
- Primal-dual coding to probe light transportACM Transactions on Graphics, 2012
- Recovering three-dimensional shape around a corner using ultrafast time-of-flight imagingNature Communications, 2012
- Single view reflectance capture using multiplexed scattering and time-of-flight imagingACM Transactions on Graphics, 2011
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Clipped noisy images: Heteroskedastic modeling and practical denoisingSignal Processing, 2009
- On the limited memory BFGS method for large scale optimizationMathematical Programming, 1989
- Random sample consensusCommunications of the ACM, 1981
- Light-in-flight recording by holographyOptics Letters, 1978
- Illumination for computer generated picturesCommunications of the ACM, 1975