Abstract
Compared with traditional remoting image, there is a large amount of spectral information in the hyperspectral image (HSI), which makes HSI better reflect the actual condition of surface features. However, due to the limitations of imaging conditions, HSI tends to have a lower spatial resolution. In order to overcome this issue, we propose a spectral-spatial attention-based U-Net named SSAU-Net for HSI and multispectral image (MSI) fusion. The SSAU-Net constructs a spectral-spatial attention module by a coordinate-attention (CA) module and an efficient pyramid split attention (ESPA) module, which can enhance the image’s spectral information and spatial information. Meanwhile, the proposed network fully extracts the shallow and deep features of the images, and finally generates high-resolution (HR) hyperspectral images. Compared with state-of-the-art HSI-MSI fusion methods, the experimental results verify that the proposed method has a better subjective and objective fusion effect.
Funding Information
  • National Natural Science Foundation of China (62172139, U1936204, U1803119)
  • National Key Research and Development Plan (2020AAA0106800)
  • Natural Science Foundation of Hebei Province (F2022201055)
  • Science Research Project of Hebei Province (BJ2020030)
  • China Postdoctoral (2022M713361)
  • Open Project Program of the National Laboratory of Pattern Recognition (202200007)
  • Natural Science Interdisciplinary Research Program of Hebei University (DXK202102)
  • Research Project of Hebei University Intelligent Financial Application Technology (HUIFAT) Research and Development Center (XGZJ2022022)
  • High-Performance Computing Center of Hebei University

This publication has 41 references indexed in Scilit: