Spectral Correlation-Based Fusion Network for Hyperspectral Image Super-Resolution
- 5 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-14
Abstract
To address the limitations of hyperspectral imaging systems, super-resolution (SR) techniques that fuse low-resolution hyperspectral image (HSI) with high-resolution multispectral image (MSI) are applied. Due to the significant modal difference between HSI and MSI, and the insufficient consideration of HSI band correlation in previous works, issues arise such as spectral distortions and loss of fine texture and boundaries. In this article, an unsupervised spectral correlation-based fusion network (SCFN) is proposed to address the above challenges. A new dense spectral convolution module (DSCM) is proposed to capture the intrinsic similarity dependence between spectral bands in HSI to effectively extract spectral domain features and mitigate spectral aberrations. To preserve the rich texture details in MSI, a global-local aware block (GAB) is designed for joint global contextual information and emphasize critical regions. To address the cross-modal disparity problem, new joint losses are constructed to improve the preservation of high-frequency information during image reconstruction and effectively minimize spectral disparity for more precise and accurate image reconstruction. The experimental results on three hyperspectral remote sensing datasets demonstrate that SCFN outperforms other methods in both qualitative and quantitative comparisons. Results from the fusion of real hyperspectral and multispectral remote sensing data further confirm the applicability and effectiveness of the proposed network.Keywords
Funding Information
- National Natural Science Foundation of China (42271413)
- Open Fund of State Key Laboratory of Remote Sensing Science (OFSLRSS202329)
This publication has 73 references indexed in Scilit:
- GlobalMind: Global multi-head interactive self-attention network for hyperspectral change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2024
- Very fine spatial resolution urban land cover mapping using an explicable sub-pixel mapping network based on learnable spatial correlationRemote Sensing of Environment, 2023
- Dynamic estimation of rice aboveground biomass based on spectral and spatial information extracted from hyperspectral remote sensing images at different combinations of growth stagesISPRS Journal of Photogrammetry and Remote Sensing, 2023
- Deep learning in multimodal remote sensing data fusion: A comprehensive reviewInternational Journal of Applied Earth Observation and Geoinformation, 2022
- Real-world remote sensing image super-resolution via a practical degradation model and a kernel-aware networkISPRS Journal of Photogrammetry and Remote Sensing, 2022
- HyperNet: A deep network for hyperspectral, multispectral, and panchromatic image fusionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Hyperspectral super-resolution via coupled tensor ring factorizationPattern Recognition, 2022
- An infrared and visible image fusion method based on multi-scale transformation and norm optimizationInformation Fusion, 2021
- A Global Context-aware and Batch-independent Network for road extraction from VHR satellite imageryISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution2020