Multilevel Progressive Network With Nonlocal Channel Attention for Hyperspectral Image Super-Resolution
- 10 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-14
Abstract
Deep convolutional neural networks (CNNs) have made great progress in the super-resolution (SR) of hyperspectral images (HSIs). However, most methods utilize convolution to explore local features, and global features are ignored. It is expected that combining non-local mechanism with CNN will improve the performance of HSI SR. This paper presents a multi-level progressive HSI SR network. The dense non-local and local block (DNLB) is constructed to combine local and global features, which are used to reconstruct super-resolution images at each level. Due to the high dimension of HSI, original non-local methods produce memory-expensive attention maps. We develop a non-local channel attention block to extract the global features of HSIs efficiently. Spatial-spectral gradient is injected in the non-local attention block to obtain better details. Furthermore, the progressive learning mode based multi-level network is proposed to reconstruct HSI with fine details. A number of experiments demonstrate that our method can reconstruct hyperspectral images more accurately than existing methods.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFA0715203)
- National Natural Science Foundation of China (62271087)
- Natural Science Foundation of Hunan Province, China (2021JJ40609)
This publication has 51 references indexed in Scilit:
- Hyperspectral Image Superresolution by Transfer LearningIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017
- Super-resolution reconstruction of hyperspectral images via low rank tensor modeling and total variation regularization2016
- Hyperspectral Image Super-Resolution by Spectral Mixture Analysis and Spatial–Spectral Group SparsityIEEE Geoscience and Remote Sensing Letters, 2016
- Accurate Image Super-Resolution Using Very Deep Convolutional Networks2016
- Hyperspectral Pansharpening: A ReviewIEEE Geoscience and Remote Sensing Magazine, 2015
- Bayesian sparse representation for hyperspectral image super resolution2015
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Super-resolution hyperspectral imaging with unknown blurring by low-rank and group-sparse modeling2014
- A comparative study of spatial approaches for urban mapping using hyperspectral ROSIS images over Pavia City, northern ItalyInternational Journal of Remote Sensing, 2009
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004