Attention-Guided Progressive Frequency-Decoupled Network for Pan-Sharpening
- 13 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-16
Abstract
Existing pan-sharpening methods focus more on the processing of spatial domain features, which is difficult to balance for multiresolution performance, and prone to difficulties such as edge blurring or artifacts. In this paper, we propose an Attention-guided Progressive Frequency-decoupled Network, termed APFNN, to improve the performance of fused images in terms of spatial enhancement and spectral fidelity. The decoupling and fusion of the frequency-domain features are used as the main body, and the two-stage progressive network framework is built with the auxiliary correction by the spatial domain features, realizing fine-grained interactive fusion of dual-domain features. To optimize the APFNN, spatial feature characteristics processed with Cascading Interactive Attention (CIAtt) are used as guidance information, combined with the features of the high-resolution panchromatic image and low-resolution multispectral image for high-frequency and low-frequency decoupling, embedded into the residual dense module to form a new feature extraction component and perform subtle frequency feature fusion. Extensive qualitative and quantitative experiments have been conducted on a variety of datasets, verifying that the proposed APFNN outperforms state-of-the-art methods both in reduced-resolution and full-resolution image pan-sharpening.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFB3903803)
- Defense Industrial Technology Development Program of China (JCKY2022415C001)
This publication has 45 references indexed in Scilit:
- Spatial-Frequency Domain Information Integration for Pan-Sharpening2022
- P2Sharpen: A progressive pansharpening network with deep spectral transformationInformation Fusion, 2022
- Memory-augmented Deep Conditional Unfolding Network for Pansharpening2022
- Mutual Information-driven Pan-sharpening2022
- A theoretical and practical survey of image fusion methods for multispectral pansharpeningInformation Fusion, 2022
- Image fusion meets deep learning: A survey and perspectiveInformation Fusion, 2021
- Deep Gradient Projection Networks for Pan-sharpening2021
- A Variational Pan-Sharpening With Local Gradient Constraints2019
- A Variational Model for P+XS Image FusionInternational Journal of Computer Vision, 2006
- FFTW: an adaptive software architecture for the FFT2002