A sub-pixel convolution-based improved bidirectional feature pyramid network for pansharpening
Authors:
- 1 January 2023
- journal article
- research article
- Published by Taylor & Francis in Remote Sensing Letters
- Vol. 14 (1) , 91-101
Abstract
Due to the dramatic scale changes in different ground object characteristics, effectively utilizing multi-scale features of remote sensing images represents a major challenge. This letter proposes a sub-pixel convolution-based improved bidirectional feature pyramid network (SCIBFPN) to address the problem. To reduce the information loss in the process of image pre-processing and multi-scale feature fusion, this letter introduces sub-pixel convolution instead of up-sampling. To obtain richer spatial and spectral information, an improved bidirectional feature pyramid network-based sub-pixel convolution is combined with a residual network (ResNet) for feature extraction. In addition, to further enhance the spatial structure of the fused images, a panchromatic (PAN) image is used as a guide to direct the injection of spatial information. Experimental results from two real datasets show that the proposed method outperforms state-of-the-art methods in terms of both objective metrics and subjective visual evaluation.Keywords
Funding Information
- Henan province science and technology breakthrough project (212102210102)
This publication has 19 references indexed in Scilit:
- Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual NetworkIEEE Geoscience and Remote Sensing Letters, 2017
- A multi-objective component-substitution-based pansharpening2017
- Pansharpening by Convolutional Neural NetworksRemote Sensing, 2016
- A Critical Comparison Among Pansharpening AlgorithmsIEEE Transactions on Geoscience and Remote Sensing, 2014
- A Variational Approach for Pan-SharpeningIEEE Transactions on Image Processing, 2013
- A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial ReplacementIEEE Transactions on Geoscience and Remote Sensing, 2010
- Multiple endmember spectral-angle-mapper (sam) analysis improves discrimination of savanna tree species2009
- Multispectral and Panchromatic Data Fusion Assessment Without ReferencePhotogrammetric Engineering & Remote Sensing, 2008
- A Global Quality Measurement of Pan-Sharpened Multispectral ImageryIEEE Geoscience and Remote Sensing Letters, 2004
- A new look at IHS-like image fusion methodsInformation Fusion, 2001