Modality-Prior Aware Progressive Diffusion Pansharpening
- 11 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64 (01962892) , 1-15
Abstract
Pansharpening entails significant challenges in fully exploiting the synergistic potential between generative expressiveness and discriminative precision, requiring advanced generative modeling guided by discriminative priors. To this end, a unified end-to-end, modality-prior aware progressive diffusion model (PPDM-Pan) is presented that dynamically integrates discriminative priors with generative representations through a progressive fusion process, achieving synergistic feature interaction and enhanced spatial–spectral consistency for high-fidelity high-resolution multispectral reconstruction. Specifically, to explicitly extract modality-specific discriminative priors, a modal prior guidance (MPG) encoder is designed to models complementary spatial and spectral priors from heterogeneous panchromatic (PAN) and low-resolution multispectral (LRMS) inputs, establishing robust modality-aware representations. Subsequently, a diffusion process is leveraged to model the complex, high-dimensional PAN-LRMS distribution and synthesize expressive latent features with enhanced generative capacity. Crucially, to orchestrate synergistic integration of generative features and discriminative priors, a progressive modality-aware fusion (PMAF) strategy is introduced that hierarchically refines multi-level representations through content-aware dynamic learning, reconciling their inherent trade-offs to deliver high-fidelity reconstruction with superior spatial-spectral consistency. Experiments on QuickBird, GaoFen-2, and WorldView-3 datasets demonstrate its superior performance in balancing spatial realism, characterized by visually realistic textures and structural details, and spectral fidelity, highlighting its effectiveness as a robust and versatile solution.Keywords
Funding Information
- Tianjin Municipal Key Research and Development Program (25YFGKHZ00150)
- Guangxi Science and Technology Major Program (AA23062045)
- Guangxi Science and Technology Major Program (AA23062052)
- National Natural Science Foundation of China (U22B2054)
- National Natural Science Foundation of China (62076192)
- National Natural Science Foundation of China (62276199)
- National Natural Science Foundation of China (62431020)
- National Natural Science Foundation of China (62276201)
- Higher Education Discipline Innovation Project
- Program for Cheung Kong Scholars and Innovative Research Team in University (IRT 15R53)
- Science and Technology Innovation Project from Chinese Ministry of Education
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi’an Jiaotong University (HMHAI-202404)
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi’an Jiaotong University (HMHAI-202405)
- Fundamental Research Funds for Central Public Welfare Research Institutes (TKS20240101)
- Fundamental Research Funds for Central Public Welfare Research Institutes (TKS20250403)
- Science and Technology Program of Zhejiang Provincial Department of Transportation (2024037)
- Natural Science Basic Research Program of Shaanxi (2025JC-YBQN-827)
This publication has 58 references indexed in Scilit:
- Unsupervised coefficient learning framework for variational pansharpeningInformation Fusion, 2025
- A pan-sharpening model using dual-branch attention-guided diffusion networksInformation Fusion, 2025
- Deep spatial–spectral fusion transformer for remote sensing pansharpeningInformation Fusion, 2025
- Pan-Mamba: Effective pan-sharpening with state space modelInformation Fusion, 2024
- SFINet: A semantic feature interactive learning network for full-time infrared and visible image fusionExpert Systems with Applications, 2024
- Diffusion model with disentangled modulations for sharpening multispectral and hyperspectral imagesInformation Fusion, 2023
- Laplacian pyramid networks: A new approach for multispectral pansharpeningInformation Fusion, 2022
- Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusionInformation Fusion, 2020
- Remote sensing image fusion based on two-stream fusion networkInformation Fusion, 2020
- Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniquesRemote Sensing of Environment, 1987