Unleashing Fourier-Domain Potential: Spatial–Spectral Reconstruction Framework for Remote Sensing Pansharpening
- 23 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-13
Abstract
Pansharpening aims to generate high-resolution multispectral (HR-MS) images by fusing the corresponding low-resolution multispectral (LR-MS) and high-resolution panchromatic (PAN) images. While the spatial-spectral properties modeling plays crucial roles in generating high-quality HR-MS images, existing approaches suffer from: 1) directly modeling the entangled spatial-spectral properties; and 2) lacking task-specific priors for spatial and spectral properties modeling. This paper proposes a novel Fourier domain-based approach (Fourier-SSR) to address these problems, where phase and amplitude components of PAN and LR-MS are considered to individually model spatial and spectral properties for the target HR-MS image. Our Fourier-SSR is motivated by the crucial findings in Fourier domain: (i) manifestation of spatial-spectral properties, i.e., the spatial and spectral properties of remote sensing images can be individually manifested in their phase and amplitude components in Fourier domain; (ii) spatial property-related prior, i.e., only reconstructing the phase component of PAN image in Fourier domain, could generate spatial property required for target HR-MS image; and (iii) spectral property-related prior, i.e., jointly models the amplitude components of PAN and LR-MS images could generate the required spectral property for target HR-MS image. Based on the aforementioned findings, we design a Fourier-guided spatial Mixer and a Fourier-guided spectral Mixer, which innovatively employ complex feature interaction strategies to individually reconstruct the phase and amplitude components for target HR-MS. Experiments show that our methods unleash Fourier domain potential in individually modeling spatial and spectral properties for the target HR-MS image, leading to superior performance over previous state-of-the-art. Our code is provided in Supplementary Material.Keywords
Funding Information
- Natural Science Foundation of Shaanxi Province (2024JC-YBMS-569)
- Key Research and Development Program of Ningbo City (2023Z130)
This publication has 57 references indexed in Scilit:
- TCL-Net: A Lightweight and Efficient Dehazing Network with Frequency-Domain Fusion and Multi-Angle Attention2024
- DBFFT: Adversarial-robust dual-branch frequency domain feature fusion in vision transformersInformation Fusion, 2024
- Frequency and Spatial Dual Guidance for Image Dehazing2022
- Spatial-Frequency Domain Information Integration for Pan-Sharpening2022
- CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer2022
- Multitrait machine‐ and deep‐learning models for genomic selection using spectral information in a wheat breeding programThe Plant Genome, 2021
- Application of hyperspectral remote sensing for environment monitoring in mining areasEnvironmental Earth Sciences, 2011
- A Variational Model for P+XS Image FusionInternational Journal of Computer Vision, 2006
- Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial detailsInternational Journal of Remote Sensing, 2000
- Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniquesRemote Sensing of Environment, 1987