Deep plug-and-play priors for spectral snapshot compressive imaging
Authors:
- Siming ZhengSZSiming Zheng
- Yang LiuYLYang Liu
- Ziyi MengZMZiyi Meng
- Mu QiaoMQMu Qiao
- Zhishen TongZTZhishen Tong
- Xiaoyu YangXYXiaoyu Yang
- Shensheng HanSHShensheng Han
- Xin YuanXYXin Yuan
- 21 January 2021
- journal article
- research article
- Published by Optica Publishing Group in Photonics Research
- Vol. 9 (2) , B18-B29
Abstract
We propose a plug-and-play (PnP) method that uses deep-learning-based denoisers as regularization priors for spectral snapshot compressive imaging (SCI). Our method is efficient in terms of reconstruction quality and speed trade-off, and flexible enough to be ready to use for different compressive coding mechanisms. We demonstrate the efficiency and flexibility in both simulations and five different spectral SCI systems and show that the proposed deep PnP prior could achieve state-of-the-art results with a simple plug-in based on the optimization framework. This paves the way for capturing and recovering multi- or hyperspectral information in one snapshot, which might inspire intriguing applications in remote sensing, biomedical science, and material science. Our code is available at: https://github.com/zsm1211/PnP-CASSI.Keywords
This publication has 60 references indexed in Scilit:
- Compact spectrometer based on a disordered photonic chipNature Photonics, 2013
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- The restricted isometry property and its implications for compressed sensingComptes Rendus Mathématique, 2008
- Single-shot compressive spectral imaging with a dual-disperser architectureOptics Express, 2007
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006
- Stable signal recovery from incomplete and inaccurate measurementsCommunications on Pure and Applied Mathematics, 2006
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Updating the Inverse of a MatrixSIAM Review, 1989
- The C.I.E. colorimetric standards and their useTransactions of the Optical Society, 1931