SSAU-Net: A Spectral–Spatial Attention-Based U-Net for Hyperspectral Image Fusion
Open Access
- 26 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-16
Abstract
Compared with traditional remoting image, there is a large amount of spectral information in the hyperspectral image (HSI), which makes HSI better reflect the actual condition of surface features. However, due to the limitations of imaging conditions, HSI tends to have a lower spatial resolution. In order to overcome this issue, we propose a spectral-spatial attention-based U-Net named SSAU-Net for HSI and multispectral image (MSI) fusion. The SSAU-Net constructs a spectral-spatial attention module by a coordinate-attention (CA) module and an efficient pyramid split attention (ESPA) module, which can enhance the image’s spectral information and spatial information. Meanwhile, the proposed network fully extracts the shallow and deep features of the images, and finally generates high-resolution (HR) hyperspectral images. Compared with state-of-the-art HSI-MSI fusion methods, the experimental results verify that the proposed method has a better subjective and objective fusion effect.Keywords
Funding Information
- National Natural Science Foundation of China (62172139, U1936204, U1803119)
- National Key Research and Development Plan (2020AAA0106800)
- Natural Science Foundation of Hebei Province (F2022201055)
- Science Research Project of Hebei Province (BJ2020030)
- China Postdoctoral (2022M713361)
- Open Project Program of the National Laboratory of Pattern Recognition (202200007)
- Natural Science Interdisciplinary Research Program of Hebei University (DXK202102)
- Research Project of Hebei University Intelligent Financial Application Technology (HUIFAT) Research and Development Center (XGZJ2022022)
- High-Performance Computing Center of Hebei University
This publication has 41 references indexed in Scilit:
- Hyperspectral Super-Resolution by Coupled Spectral Unmixing2015
- Weighted-RXD and Linear Filter-Based RXD: Improving Background Statistics Estimation for Anomaly Detection in Hyperspectral ImageryIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- Advances in Spectral-Spatial Classification of Hyperspectral ImagesProceedings of the IEEE, 2012
- Statistics of real-world hyperspectral images2011
- Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and SpectrumIEEE Transactions on Image Processing, 2010
- Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan DataIEEE Transactions on Geoscience and Remote Sensing, 2007
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A universal image quality indexIEEE Signal Processing Letters, 2002
- Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial detailsInternational Journal of Remote Sensing, 2000
- The spectral image processing system (SIPS)—interactive visualization and analysis of imaging spectrometer dataRemote Sensing of Environment, 1993