Dual Stage Semantic Information Based Generative Adversarial Network For Image Super-Resolution✱
Open Access
- 15 December 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Abstract
Deep learning methods for the super-resolution problem are showing great performance compared to other traditional techniques. However, these methods are unable to learn complex spatial structures and high frequency details; which leads to over-smooth results. In the present paper, a novel Generative Adversarial Network based architecture named as Residue and Semantic feature based Dual Subpixel Generative Adversarial Network has been proposed for generator and discriminator networks to solve super-resolution problem. The generator network is residue and semantic feature based dual subpixel generative architecture. This architecture is divided into two stages: premier residual stage and deuxieme residual stage. These two stages are concatenated together to form a two stage upsamping process, which enhances the feature learning capability of our model. Inter and intra residual connections are made within these two stages; helping us to sustain the high texture details of images. Semantic based information is implanted in generator to enhance the quality of objects in an image. For embedding semantic information in generator, feature maps extracted from pre-trained model are merged with the input image. To stabilize the training process, we introduced spectral normalization in the discriminator. Visual perception and mean opinion score shows that proposed method outperforms the other state-of-the-art methods.Keywords
This publication has 31 references indexed in Scilit:
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Super-Resolution for Computed Tomography Based on Discrete TomographyIEEE Transactions on Image Processing, 2014
- Learning a Deep Convolutional Network for Image Super-Resolution2014
- Single Image Super-Resolution Based on Local Self-Similarity2013
- Super‐resolution in magnetic resonance imaging: A reviewConcepts in Magnetic Resonance Part A, 2012
- Gradient Profile Prior and Its Applications in Image Super-Resolution and EnhancementIEEE Transactions on Image Processing, 2010
- Super-Resolution Without Explicit Subpixel Motion EstimationIEEE Transactions on Image Processing, 2009
- Super-Resolution in Medical ImagingThe Computer Journal, 2008
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006
- Example-based super-resolutionIEEE Computer Graphics and Applications, 2002