Hyperspectral Image Reconstruction of SD-CASSI Based on Nonlocal Low-Rank Tensor Prior
- 8 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-15
Abstract
In single disperser coded aperture snapshot spectral imaging (SD-CASSI) systems, many methods have been developed to reconstruct hyperspectral images (HSIs) from compressed measurements. Among these, deep learning (DL)-based methods have stood out, relying on powerful DL networks. However, the solidified structure of DL-based methods limits their adaptability. Moreover, they are often based on a model that neglects the dispersion process and instead emphasizes the encoding-compression process. Furthermore, research on optimization-based methods designed especially for SD-CASSI is lacking. In this article, we propose a comprehensive two-step projection imaging model for SD-CASSI that includes both spectral shearing projection and encoding-compression projection. Based on this model, we derive a tensor-based optimization framework that incorporates with the nonlocal low-rank tensor (NLRT) prior. In particular, NLRT extracts inherent spatial structural information from the measurements and employs it to guide the clustering of spatial–spectral similar HSI blocks. A CANDECOMP/PARAFAC (CP) low-rank regularizer is introduced to constrain the low-rank property of HSI block clusters. After that, we develop a solution framework based on the alternating direction method of multiplier (ADMM) approach. Comprehensive experiments demonstrate that our NLRT method outperforms state-of-the-art methods in terms of flexibility and performance. The source code and data of this article are publicly available at https://github.com/sdnjyxr/NLRT .Keywords
Funding Information
- National Natural Science Foundation of China (61635002)
- Open Research Fund of Shaanxi Key Laboratory of Optical Remote Sensing and Intelligent Information Processing (KF20230201)
- Fundamental Research Funds for the Central Universities
This publication has 53 references indexed in Scilit:
- Deep Unfolding for Snapshot Compressive ImagingInternational Journal of Computer Vision, 2023
- Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction2022
- Total variation regularized nonlocal low-rank tensor train for spectral compressive imagingSignal Processing, 2022
- Nonconvex Optimization for Robust Tensor Completion from Grossly Sparse ObservationsJournal of Scientific Computing, 2020
- End-to-End Low Cost Compressive Spectral Imaging with Spatial-Spectral Self-Attention2020
- Spectrum Reconstruction of the Light-Field Multimodal ImagerIEEE Access, 2019
- Sparse Recovery of Hyperspectral Signal from Natural RGB Images2016
- Statistics of real-world hyperspectral images2011
- Some Mathematical Notes on Three-Mode Factor AnalysisPsychometrika, 1966
- The Expression of a Tensor or a Polyadic as a Sum of ProductsJournal of Mathematics and Physics, 1927