Multispectral and Hyperspectral Image Fusion by MS/HS Fusion Net
Authors:
Top Cited Papers
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1585-1594
Abstract
Hyperspectral imaging can help better understand the characteristics of different materials, compared with traditional image systems. However, only high-resolution multispectral (HrMS) and low-resolution hyperspectral (LrHS) images can generally be captured at video rate in practice. In this paper, we propose a model-based deep learning approach for merging an HrMS and LrHS images to generate a high-resolution hyperspectral (HrHS) image. In specific, we construct a novel MS/HS fusion model which takes the observation models of low-resolution images and the low-rankness knowledge along the spectral mode of HrHS image into consideration. Then we design an iterative algorithm to solve the model by exploiting the proximal gradient method. And then, by unfolding the designed algorithm, we construct a deep network, called MS/HS Fusion Net, with learning the proximal operators and model parameters by convolutional neural networks. Experimental results on simulated and real data substantiate the superiority of our method both visually and quantitatively as compared with state-of-the-art methods along this line of research.Keywords
All Related Versions
This publication has 46 references indexed in Scilit:
- Hyperspectral imagery super-resolution by sparse representation and spectral regularizationEURASIP Journal on Advances in Signal Processing, 2011
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral imagesApplied and Computational Harmonic Analysis, 2008
- Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan DataIEEE Transactions on Geoscience and Remote Sensing, 2007
- MAP Estimation for Hyperspectral Image Resolution Enhancement Using an Auxiliary SensorIEEE Transactions on Image Processing, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial detailsInternational Journal of Remote Sensing, 2000
- Bayesian and regularization methods for hyperparameter estimation in image restorationIEEE Transactions on Image Processing, 1999
- De-noising by soft-thresholdingIEEE Transactions on Information Theory, 1995
- A theory for multiresolution signal decomposition: the wavelet representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989