Image super-resolution via deterministic-stochastic synthesis and local statistical rectification
Authors:
Open Access
- 4 December 2018
- journal article
- conference paper
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 37 (6) , 1-14
Abstract
Single image superresolution has been a popular research topic in the last two decades and has recently received a new wave of interest due to deep neural networks. In this paper, we approach this problem from a different perspective. With respect to a downsampled low resolution image, we model a high resolution image as a combination of two components, a deterministic component and a stochastic component. The deterministic component can be recovered from the low-frequency signals in the downsampled image. The stochastic component, on the other hand, contains the signals that have little correlation with the low resolution image. We adopt two complementary methods for generating these two components. While generative adversarial networks are used for the stochastic component, deterministic component reconstruction is formulated as a regression problem solved using deep neural networks. Since the deterministic component exhibits clearer local orientations, we design novel loss functions tailored for such properties for training the deep regression network. These two methods are first applied to the entire input image to produce two distinct high-resolution images. Afterwards, these two images are fused together using another deep neural network that also performs local statistical rectification, which tries to make the local statistics of the fused image match the same local statistics of the groundtruth image. Quantitative results and a user study indicate that the proposed method outperforms existing state-of-the-art algorithms with a clear margin.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Learning a Deep Convolutional Network for Image Super-Resolution2014
- On Single Image Scale-Up Using Sparse-Representations2012
- A Parameterless Line Segment and Elliptical Arc Detector with Enhanced Ellipse Fitting2012
- A novel image fusion method using IKONOS satellite imagesJournal of Geodesy and Geoinformation, 2012
- Edge-preserving single image super-resolution2011
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- High-resolution images from low-resolution compressed videoIEEE Signal Processing Magazine, 2003
- Example-based super-resolutionIEEE Computer Graphics and Applications, 2002