Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging
Authors:
Open Access
- 12 April 2021
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 12 (1) , 1-9
Abstract
Cameras with extreme speeds are enabling technologies in both fundamental and applied sciences. However, existing ultrafast cameras are incapable of coping with extended three-dimensional scenes and fall short for non-line-of-sight imaging, which requires a long sequence of time-resolved two-dimensional data. Current non-line-of-sight imagers, therefore, need to perform extensive scanning in the spatial and/or temporal dimension, restricting their use in imaging only static or slowly moving objects. To address these long-standing challenges, we present here ultrafast light field tomography (LIFT), a transient imaging strategy that offers a temporal sequence of over 1000 and enables highly efficient light field acquisition, allowing snapshot acquisition of the complete four-dimensional space and time. With LIFT, we demonstrated three-dimensional imaging of light in flight phenomena with a <10 picoseconds resolution and non-line-of-sight imaging at a 30 Hz video-rate. Furthermore, we showed how LIFT can benefit from deep learning for an improved and accelerated image formation. LIFT may facilitate broad adoption of time-resolved methods in various disciplines.Keywords
Funding Information
- National Science Foundation (CAREER 1652150)
- Foundation for the National Institutes of Health (R01EY029397)
This publication has 42 references indexed in Scilit:
- Detection and tracking of moving objects hidden from viewNature Photonics, 2015
- Single-shot compressed ultrafast photography at one hundred billion frames per secondNature, 2014
- Sequentially timed all-optical mapping photography (STAMP)Nature Photonics, 2014
- Femto-photographyACM Transactions on Graphics, 2013
- Recovering three-dimensional shape around a corner using ultrafast time-of-flight imagingNature Communications, 2012
- Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomenaNature, 2009
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- The Challenges of Clustering High Dimensional Data2004
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- The Ill-Conditioned Nature of the Limited Angle Tomography ProblemSIAM Journal on Applied Mathematics, 1983