DNU: Deep Non-Local Unrolling for Computational Spectral Imaging
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1658-1668
Abstract
Computational spectral imaging has been striving to capture the spectral information of the dynamic world in the last few decades. In this paper, we propose an interpretable neural network for computational spectral imaging. First, we introduce a novel data-driven prior that can adaptively exploit both the local and non-local correlations among the spectral image. Our data-driven prior is integrated as a regularizer into the reconstruction problem. Then, we propose to unroll the reconstruction problem into an optimization-inspired deep neural network. The architecture of the network has high interpretability by explicitly characterizing the image correlation and the system imaging model. Finally, we learn the complete parameters in the network through end-to-end training, enabling robust performance with high spatial-spectral fidelity. Extensive simulation and hardware experiments validate the superior performance of our method over state-of-the-art methods.Keywords
This publication has 58 references indexed in Scilit:
- Spatial-spectral encoded compressive hyperspectral imagingACM Transactions on Graphics, 2014
- Medical hyperspectral imaging: a reviewJournal of Biomedical Optics, 2014
- Compressive Coded Aperture Spectral Imaging: An IntroductionIEEE Signal Processing Magazine, 2013
- 3D imaging spectroscopy for measuring hyperspectral patterns on solid objectsACM Transactions on Graphics, 2012
- Tracking and Identification via Object Reflectance Using a Hyperspectral Video Camera2011
- Snapshot Image Mapping Spectrometer (IMS) with high sampling density for hyperspectral microscopyOptics Express, 2010
- A New Alternating Minimization Algorithm for Total Variation Image ReconstructionSIAM Journal on Imaging Sciences, 2008
- A Non-Local Algorithm for Image Denoising2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- The spectral image processing system (SIPS)—interactive visualization and analysis of imaging spectrometer dataRemote Sensing of Environment, 1993