Untrained networks for compressive lensless photography
- 18 June 2021
- journal article
- research article
- Published by Optica Publishing Group in Optics Express
- Vol. 29 (13) , 20913-20929
Abstract
Compressive lensless imagers enable novel applications in an extremely compact device, requiring only a phase or amplitude mask placed close to the sensor. They have been demonstrated for 2D and 3D microscopy, single-shot video, and single-shot hyperspectral imaging; in each case, a compressive-sensing-based inverse problem is solved in order to recover a 3D data-cube from a 2D measurement. Typically, this is accomplished using convex optimization and hand-picked priors. Alternatively, deep learning-based reconstruction methods offer the promise of better priors, but require many thousands of ground truth training pairs, which can be difficult or impossible to acquire. In this work, we propose an unsupervised approach based on untrained networks for compressive image recovery. Our approach does not require any labeled training data, but instead uses the measurement itself to update the network weights. We demonstrate our untrained approach on lensless compressive 2D imaging, single-shot high-speed video recovery using the camera’s rolling shutter, and single-shot hyperspectral imaging. We provide simulation and experimental verification, showing that our method results in improved image quality over existing methods.Keywords
All Related Versions
Funding Information
- Chan Zuckerberg Initiative
- National Science Foundation (DGE 1752814, DMR 1548924)
- Gordon and Betty Moore Foundation (GBMF4562)
This publication has 30 references indexed in Scilit:
- Single-shot compressed ultrafast photography at one hundred billion frames per secondNature, 2014
- Imaging With Nature: Compressive Imaging Using a Multiply Scattering MediumScientific Reports, 2014
- Compressive light field photography using overcomplete dictionaries and optimized projectionsACM Transactions on Graphics, 2013
- Coded aperture compressive temporal imagingOptics Express, 2013
- Nonlocal Transform-Domain Filter for Volumetric Data Denoising and ReconstructionIEEE Transactions on Image Processing, 2012
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- An Introduction To Compressive SamplingIEEE Signal Processing Magazine, 2008
- Single disperser design for coded aperture snapshot spectral imagingApplied Optics, 2008
- Single-shot compressive spectral imaging with a dual-disperser architectureOptics Express, 2007
- Image and depth from a conventional camera with a coded apertureACM Transactions on Graphics, 2007