Hyperspectral Image Super-Resolution with Deep Priors and Degradation Model Inversion
Authors:
- 23 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2814-2818
Abstract
To overcome inherent hardware limitations of hyperspectral imaging systems with respect to their spatial resolution, fusion-based hyper-spectral image (HSI) super-resolution is attracting increasing attention. This technique aims to fuse a low-resolution (LR) HSI and a conventional high-resolution (HR) RGB image in order to obtain an HR HSI. Recently, deep learning architectures have been used to address the HSI super-resolution problem and have achieved remarkable performance. However, they ignore the degradation model even though this model has a clear physical interpretation and may contribute to improving the performance. We address this problem by proposing a method that, on the one hand, makes use of the linear degradation model in the data-fidelity term of the objective function and, on the other hand, utilizes the output of a convolutional neural network for designing a deep prior regularizer in spectral and spatial gradient domains. Experiments show the performance improvement achieved with this strategy.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Multiband Image Fusion Based on Spectral UnmixingIEEE Transactions on Geoscience and Remote Sensing, 2016
- Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse RepresentationIEEE Transactions on Image Processing, 2016
- Hyperspectral Super-Resolution by Coupled Spectral Unmixing2015
- Fast Fusion of Multi-Band Images Based on Solving a Sylvester EquationIEEE Transactions on Image Processing, 2015
- Nonlinear Estimation of Material Abundances in Hyperspectral Images With $\ell_{1}$-Norm Spatial RegularizationIEEE Transactions on Geoscience and Remote Sensing, 2013
- Fast Positive Deconvolution of Hyperspectral ImagesIEEE Transactions on Image Processing, 2012
- Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and SpectrumIEEE Transactions on Image Processing, 2010
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Nonlinear image recovery with half-quadratic regularizationIEEE Transactions on Image Processing, 1995
- Algorithm 432 [C2]: Solution of the matrix equation AX + XB = C [F4]Communications of the ACM, 1972