Video Super-Resolution Based on Generative Adversarial Network and Edge Enhancement
Open Access
- 13 February 2021
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 10 (4) , 459
Abstract
With the help of deep neural networks, video super-resolution (VSR) has made a huge breakthrough. However, these deep learning-based methods are rarely used in specific situations. In addition, training sets may not be suitable because many methods only assume that under ideal circumstances, low-resolution (LR) datasets are downgraded from high-resolution (HR) datasets in a fixed manner. In this paper, we proposed a model based on Generative Adversarial Network (GAN) and edge enhancement to perform super-resolution (SR) reconstruction for LR and blur videos, such as closed-circuit television (CCTV). The adversarial loss allows discriminators to be trained to distinguish between SR frames and ground truth (GT) frames, which is helpful to produce realistic and highly detailed results. The edge enhancement function uses the Laplacian edge module to perform edge enhancement on the intermediate result, which helps further improve the final results. In addition, we add the perceptual loss to the loss function to obtain a higher visual experience. At the same time, we also tried training network on different datasets. A large number of experiments show that our method has advantages in the Vid4 dataset and other LR videos.Keywords
Funding Information
- National Natural Science Foundation of China (62020106011)
- the Shanghai Science and Technology Commission Project (20DZ2290100)
This publication has 46 references indexed in Scilit:
- Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
- Chroma key background detection for digital video using statistical correlation of blurring artifactDigital Investigation, 2016
- Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and ApplicationsIEEE Transactions on Computational Imaging, 2016
- Accurate Image Super-Resolution Using Very Deep Convolutional Networks2016
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- Video Super-Resolution With Convolutional Neural NetworksIEEE Transactions on Computational Imaging, 2016
- Nonlocally Centralized Sparse Representation for Image RestorationIEEE Transactions on Image Processing, 2012
- Image Super-Resolution Via Sparse RepresentationIEEE Transactions on Image Processing, 2010
- Superresolution by localization of quantum dots using blinking statisticsOptics Express, 2005
- Example-based super-resolutionIEEE Computer Graphics and Applications, 2002