The Use of a Stable Super-Resolution Generative Adversarial Network (SSRGAN) on Remote Sensing Images
Open Access
- 22 October 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (20) , 5064
Abstract
Because of the complicated imaging conditions in space and the finite imaging systems on satellites, the resolution of remote sensing images is limited. The process of increasing an image’s resolution, image super-resolution, aims to obtain a clearer image. High-resolution (HR) images are affected by various input conditions, such as motion, imaging blur, down-sampling matrix, and various types of noise. Changes in these conditions seriously affect low-resolution (LR) images, so if the imaging process is a pathological problem, super-resolution reconstruction is a pathological anti-problem. To optimize the imaging quality of satellites without changing the optical system, we chose to reconstruct images acquired by satellites using deep learning. We changed the original super-resolution generative adversarial nets network, upgraded the generator’s network part to ResNet-50, and inserted an additional fully connected (FC) layer in the network of the discriminator part. We also modified the loss function by changing the weight of regularization loss from 2 × 10−8 to 2 × 10−9, aiming to preserve more detail. In addition, we carefully and specifically chose remote sensing images taken under low-light circumstances from GF-5 satellites to form a new dataset for training and validation. The test results proved that our method can obtain good results. The reconstruction peak signal-to-noise ratio (PSNR) at the scaling factors of 2, 3, and 4 reached 32.6847, 31.8191, and 30.5095 dB, respectively, and the corresponding structural similarity (SSIM) reached 0.8962, 0.8434, and 0.8124. The super-resolution speed was also satisfactory, making real-time reconstruction more probable.Keywords
Funding Information
- the Major Program of the National Natural Science Foundation of China (42192582, 2022YFB3902000)
- the National Key R&D Program of China (42192582, 2022YFB3902000)
This publication has 26 references indexed in Scilit:
- Image super-resolution: The techniques, applications, and futureSignal Processing, 2016
- Ship Detection in Spaceborne Optical Image With SVD NetworksIEEE Transactions on Geoscience and Remote Sensing, 2016
- Remote sensing image super-resolution: Challenges and approaches2015
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Super Resolution Image Generation Using Wavelet Domain Interpolation With Edge Extraction via a Sparse RepresentationIEEE Geoscience and Remote Sensing Letters, 2014
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- PLEIADES SYSTEM ARCHITECTURE AND MAIN PERFORMANCESThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2012
- Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive RegularizationIEEE Transactions on Image Processing, 2011
- Image Super-Resolution Via Sparse RepresentationIEEE Transactions on Image Processing, 2010