ADMM-HFNet: A Matrix Decomposition-Based Deep Approach for Hyperspectral Image Fusion
- 24 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-17
Abstract
Hyperspectral image (HSI) fusion refers to the reconstruction of a high-resolution HSI by fusing a low-resolution HSI (LR-HSI) and a high-resolution multispectral image (HR-MSI) over the same scene. Recently, researchers have proposed many approaches to handle this issue. However, most of them assume that both the spatial and spectral degradation functions are known, which are often limited or unavailable in reality. This article presents a novel model-driven deep network based on matrix decomposition, which considers spectral correlations and reasonably embeds the well-known observation models. Specifically, the proposed method decomposes the desired HSI into spectral basis and coefficients. The spectral basis can be estimated from the LR-HSI via singular value decomposition. To learn the coefficients, a learning model is constructed by merging the observation models, matrix decomposition, and sparsity into a concise single formulation. For solving the proposed model, a deep framework is built by unrolling the alternating direction method of multipliers (ADMM), dubbed as ADMM-HFNet, where the involved parameters can be learned adaptively. It is worth noting that the spectral basis cannot fully represent the desired HSI. Therefore, another model is constructed here to supplement the approximation error, which can also be embedded in the deep network. After checking on three datasets, it is found that the proposed method stands out from advanced competing techniques in both quality measures and visual effects.Keywords
Funding Information
- National Natural Science Foundation of China (62071204, 61601201)
- Natural Science Foundation of Jiangsu Province (BK20201338)
This publication has 60 references indexed in Scilit:
- Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse RepresentationIEEE Transactions on Image Processing, 2016
- Fusion of Hyperspectral and Multispectral Images Using Spectral Unmixing and Sparse CodingIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2016
- Uniformity-Based Superpixel Segmentation of Hyperspectral ImagesIEEE Transactions on Geoscience and Remote Sensing, 2015
- Hyperspectral and multispectral image fusion using CNMF with minimum endmember simplex volume and abundance sparsity constraints2015
- A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based RegularizationIEEE Transactions on Geoscience and Remote Sensing, 2014
- Jointly sparse fusion of hyperspectral and multispectral imagery2013
- Hyperspectral imagery super-resolution by sparse representation and spectral regularizationEURASIP Journal on Advances in Signal Processing, 2011
- Statistics of real-world hyperspectral images2011
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Image quality evaluation based on image weighted separating block peak signal to noise ratio2003