Assessing Full-Resolution Pansharpening Quality: A Comparative Study of Methods and Measurements
Open Access
- 24 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 16 (19391404) , 6860-6875
Abstract
Since the introduction of pansharpening, quality assessment has played a pivotal role in related remote sensing research to ensure the overall system's reliability. Full-resolution quality assessment is a debated research topic for applications. However, full-resolution (FR) assessment faces challenges due to the absence of reference compared to reduced-resolution assessment. Moreover, the lack of ground truth makes measuring quality metrics even more challenging. To summarize the current measures for these two challenges, this paper presents a comprehensive study of FR methods. We review various FR techniques and analyze how they extract spatial and spectral features from pansharpened images without reference to High-Resolution Multispectral (HR-MS) images. A classification approach is proposed to group these methods based on their shared characteristics, making it easier for researchers and practitioners to compare and select the most appropriate FR method for specific applications. Furthermore, we provide a summary of strategies for measuring FR performance in the absence of ground truth. These strategies are classified into subjective and objective approaches. Additionally, we conduct a board analysis on a large-scale public pansharpened database with unified measuring criteria. This unified analysis allows us to present experiments from a statistical perspective, measure FR protocols' performance, and provide a broad qualitative and quantitative analysis. Overall, this study contributes to the development of pansharpening and provides guidance for selecting appropriate FR methods, as well as strategies for measuring FR performance.Keywords
Funding Information
- Major science and technology projects in Xinjiang Uygur Autonomous Region (2022A02012-2)
- Natural Science Basic Research Plan in Shaanxi Province of China (2023-JC-JQ-51)
- Xi'an Science and Technology Project (21RGZN0009)
This publication has 68 references indexed in Scilit:
- Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan DataIEEE Transactions on Geoscience and Remote Sensing, 2007
- MTF-tailored Multiscale Fusion of High-resolution MS and Pan ImageryPhotogrammetric Engineering & Remote Sensing, 2006
- A Variational Model for P+XS Image FusionInternational Journal of Computer Vision, 2006
- A Global Quality Measurement of Pan-Sharpened Multispectral ImageryIEEE Geoscience and Remote Sensing Letters, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Image fusion—the ARSIS concept and some successful implementation schemesISPRS Journal of Photogrammetry and Remote Sensing, 2003
- A new look at IHS-like image fusion methodsInformation Fusion, 2001
- A wavelet transform method to merge Landsat TM and SPOT panchromatic dataInternational Journal of Remote Sensing, 1998
- Multisensor Image Fusion Using the Wavelet TransformGraphical Models and Image Processing, 1995
- The Laplacian Pyramid as a Compact Image CodeIEEE Transactions on Communications, 1983