DD-Net: spectral imaging from a monochromatic dispersed and diffused snapshot
Authors:
- Jonathan HauserJHJonathan Hauser
- Amit ZeligmanAZAmit Zeligman
- Amir AverbuchAAAmir Averbuch
- Valery A. ZheludevVZValery A. Zheludev
- Menachem NathanMNMenachem Nathan
- 11 December 2020
- journal article
- research article
- Published by Optica Publishing Group in Applied Optics
- Vol. 59 (36) , 11196-11208
Abstract
We propose a snapshot spectral imaging method for the visible spectral range using a single monochromatic camera equipped with a two-dimensional (2D) binary-encoded phase diffuser placed at the pupil of the imaging lens and by resorting to deep learning (DL) algorithms for signal reconstruction. While spectral imaging was shown to be feasible using two cameras equipped with a single, one-dimensional (1D) binary diffuser and compressed sensing (CS) algorithms [ Appl. Opt. 59, 7853 (2020).APOPAI 0003-6935 10.1364/AO.395541 ], the suggested diffuser design expands the optical response and creates optical spatial and spectral encoding along both dimensions of the image sensor. To recover the spatial and spectral information from the dispersed and diffused (DD) monochromatic snapshot, we developed novel DL algorithms, dubbed DD-Nets, which are tailored to the unique response of the optical system, which includes either a 1D or a 2D diffuser. High-quality reconstructions of the spectral cube in simulation and lab experiments are presented for system configurations consisting of a single monochromatic camera with either a 1D or a 2D diffuser. We demonstrate that the suggested system configuration with the 2D diffuser outperforms system configurations with a 1D diffuser that utilize either DL-based or CS-based algorithms for the reconstruction of the spectral cube.Keywords
Funding Information
- Israel Science Foundation (1556/17)
- Ministry of Science, Technology and Space (3-10416, 3-13601, 3-14481, 3-16414)
- The Blavatnik Computer Science Foundation
This publication has 31 references indexed in Scilit:
- Computer-generated holograms for fiber optical communication with spatial-division multiplexingApplied Optics, 2016
- Compressed sensing snapshot spectral imaging by a regular digital camera with an added optical diffuserApplied Optics, 2016
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Compressive Hyperspectral Imaging With Side InformationIEEE Journal of Selected Topics in Signal Processing, 2015
- Single disperser design for coded aperture snapshot spectral imagingApplied Optics, 2008
- Single-shot compressive spectral imaging with a dual-disperser architectureOptics Express, 2007
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Generalized conversion from the phase function to the blazed surface-relief profile of diffractive optical elementsJournal of the Optical Society of America A, 1999
- Computed-tomography imaging spectrometer: experimental calibration and reconstruction resultsApplied Optics, 1995
- The spectral image processing system (SIPS)—interactive visualization and analysis of imaging spectrometer dataRemote Sensing of Environment, 1993