Single Remote Sensing Image Super-Resolution via a Generative Adversarial Network With Stratified Dense Sampling and Chain Training
- 28 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-22
Abstract
Super-resolution methods have significantly contributed to the improvement of the spatial resolution of remote sensing images. The development of deep learning empowers novel methods to learn informative feature representation from massive low-resolution (LR) and high-resolution (HR) image pairs. Conventional remote sensing image super-resolution methods, however, may fail in large-scale (×8,×9) super-resolution tasks. Specifically, a larger scale factor corresponds to the less information in LR images, which is a considerable challenge to super-resolution. To address the issue, we propose a novel method for single remote sensing image super-resolution (SRSISR) based on stratified dense-sampling to effectively extract image features. Specifically, the proposed super-resolution dense-sampling residual attention network (SRDSRAN) combines dense-sampling and residual learning to improve multi-level feature fusion and gradient propagation, and employs local and global attentions to learn important features and long-range interdependence in the channel and spatial dimensions. Meanwhile, we also devise a discriminator model using local and global attentions, and with the loss function integrating L 1 pixel loss, L 1 perceptual loss, and relativistic adversarial loss to obtain the perceptually realistic images. Besides, we introduce a chain training to promote the performance and expedite the training process for large-scale super-resolution. Experimental results on UC Merced image and other multispectral data demonstrated that our SRDSRAN outperformed the current state-of-the-art methods quantitatively and in visual quality, and obtained a higher classification accuracy in scene classification, proving its potential for applications with other downstream tasks. We will open source our code at https://github.com/Meng-333/SRADSGAN.Keywords
Funding Information
- National Natural Science Foundation of China (42271466, 42001323)
- National Key Research and Development Program of China (2021YFB3900900)
- Provincial Key Research and Development Program of Zhejiang (2021C01031)
- Deep-time Digital Earth (DDE) Big Science Program
This publication has 63 references indexed in Scilit:
- Single-Image Super-Resolution for Remote Sensing Data Using Deep Residual-Learning Neural Network2017
- Enhanced Deep Residual Networks for Single Image Super-Resolution2017
- Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
- Super-Resolution for Remote Sensing Images via Local–Global Combined NetworkIEEE Geoscience and Remote Sensing Letters, 2017
- AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2017
- Is image super-resolution helpful for other vision tasks?2016
- Deep Learning Based Feature Selection for Remote Sensing Scene ClassificationIEEE Geoscience and Remote Sensing Letters, 2015
- Learning a Deep Convolutional Network for Image Super-Resolution2014
- Bag-of-visual-words and spatial extensions for land-use classification2010
- Scope of validity of PSNR in image/video quality assessmentElectronics Letters, 2008