Rank Learning Based Full-Resolution Quality Evaluation Method for Pansharpened Images
Open Access
- 24 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 833-846
Abstract
Full-resolution quality evaluation model for pansharpened images is significant for remote sensing applications, yet presents a challenge of the absence of reference compared with the reduced-resolution approach. To predict the image quality accurately, it is necessary to consider the distortion during the pansharpening process. Based on an observation that the quality of pairwise images can more easily be ranked, we propose a Rank Learning Based Full-Resolution Quality Evaluation Method for Pansharpened Images. Our approach begins with the synthesizing of ranked distortion images in spatial and spectral domains. Then, we develop a pansharpening distortion-perceiving model. This model employs spatial and spectral Siamese networks to perceive distortions and applies a pair-wise learning strategy for ranked images. Consequently, we establish a Distortion-Guided Full-Resolution Quality Evaluation framework for pansharpening. This framework integrates the spatial and spectral distortion-perceiving network and is enhanced with a Dimension Alignment module and a Discrepancy Representation module, enabling effective distortion extraction among High-Resolution Multispectral, Panchromatic, and Low-Resolution Multispectral images. We conducted a series of experiments on a large-scale public pansharpened database. The experimental results demonstrate the effectiveness of our proposed approach.Keywords
Funding Information
- Major science and technology projects in Xinjiang Uygur Autonomous Region (2022A02012-2)
- Natural Science Basic Research Plan in Shaanxi Province of China (2023-JC-JQ-51)
- National Natural Science Foundation of China (62071369, 42201394)
This publication has 54 references indexed in Scilit:
- Entropy-based redundancy analysis and information screeningDigital Communications and Networks, 2023
- A Benchmarking Protocol for Pansharpening: Dataset, Preprocessing, and Quality AssessmentIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021
- Bidirectional Focused Semantic Alignment Attention Network for Cross-Modal Retrieval2021
- Pansharpening via Unsupervised Convolutional Neural NetworksIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020
- No-Reference Quality Assessment for Pansharpened Images via Opinion-Unaware LearningIEEE Access, 2019
- A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-SharpeningIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018
- RankIQA: Learning from Rankings for No-Reference Image Quality Assessment2017
- PanNet: A Deep Network Architecture for Pan-Sharpening2017
- Quality assessment of pan-sharpening methods2014
- Image fusion—the ARSIS concept and some successful implementation schemesISPRS Journal of Photogrammetry and Remote Sensing, 2003