Backtracking Reconstruction Network for Three-Dimensional Compressed Hyperspectral Imaging
Open Access
- 17 May 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (10) , 2406
Abstract
Compressed sensing (CS) has been widely used in hyperspectral (HS) imaging to obtain hyperspectral data at a sub-Nyquist sampling rate, lifting the efficiency of data acquisition. Yet, reconstructing the acquired HS data via iterative algorithms is time consuming, which hinders the real-time application of compressed HS imaging. To alleviate this problem, this paper makes the first attempt to adopt convolutional neural networks (CNNs) to reconstruct three-dimensional compressed HS data by backtracking the entire imaging process, leading to a simple yet effective network, dubbed the backtracking reconstruction network (BTR-Net). Concretely, we leverage the divide-and-conquer method to divide the imaging process based on coded aperture tunable filter (CATF) spectral imager into steps, and build a subnetwork for each step to specialize in its reverse process. Consequently, BTR-Net introduces multiple built-in networks which performs spatial initialization, spatial enhancement, spectral initialization and spatial–spectral enhancement in an independent and sequential manner. Extensive experiments show that BTR-Net can reconstruct compressed HS data quickly and accurately, which outperforms leading iterative algorithms both quantitatively and visually, while having superior resistance to noise.Keywords
Funding Information
- National Natural Science Foundation of China (61527802, TCGZ2020C004, 202020429036)
- National Key Laboratory Foundation of China (61527802, TCGZ2020C004, 202020429036)
This publication has 40 references indexed in Scilit:
- A survey on representation-based classification and detection in hyperspectral remote sensing imageryPattern Recognition Letters, 2016
- From Denoising to Compressed SensingIEEE Transactions on Information Theory, 2016
- Automatic Segmentation of MR Brain Images With a Convolutional Neural NetworkIEEE Transactions on Medical Imaging, 2016
- Segmenting Retinal Blood Vessels WithDeep Neural NetworksIEEE Transactions on Medical Imaging, 2016
- Deep learning in neural networks: An overviewNeural Networks, 2015
- Spatial-spectral encoded compressive hyperspectral imagingACM Transactions on Graphics, 2014
- Synergies between VSWIR and TIR data for the urban environment: An evaluation of the potential for the Hyperspectral Infrared Imager (HyspIRI) Decadal Survey missionRemote Sensing of Environment, 2012
- Application of hyperspectral remote sensing for environment monitoring in mining areasEnvironmental Earth Sciences, 2011
- Single disperser design for coded aperture snapshot spectral imagingApplied Optics, 2008
- Optical architectures for compressive imagingApplied Optics, 2007