Super-Interpolation With Edge-Orientation-Based Mapping Kernels for Low Complex Upscaling
Authors:
- 9 December 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 25 (1) , 469-483
Abstract
With the advent of ultrahigh-definition (UHD) video services, super-resolution (SR) techniques are often required to generate high-resolution (HR) images from low-resolution (LR) images, such as HD images. To generate such HR images and a video of UHD resolutions in limited computing devices with hardware and software, low complex but excellent SR methods are particularly required. In this paper, we present a novel and fast SR method, called super-interpolation (SI), by unifying an interpolation step and a quality-enhancement step. The proposed SI method utilizes edge-orientation (EO)-based pre-learned kernels, which inherits the simplicity of interpolation and the quality enhancement of SR. It performs SR directly from the initial resolution of an input image to the target resolution of an up-scaled output image without requiring any intermediate interpolated image. The proposed SI method involves offline training and online up-scaling phases. In the offline training phase, training LR image patches are clustered based on their edge orientations into different EO classes for which class-dependent linear mapping functions are learned between training LR and HR image patches. In up-scaling phase, an HR output image patch for each LR input image patch is generated by applying an appropriate linear mapping function selected based on the EO of LR input image patch. Our proposed SI method is intensively compared with the ten state-of-the-art SR methods for common image sets and many HD/UHD images. The experimental results show that the SI method yields the smallest running time and requires relatively small hardware resources. It outperforms the six state-of-the-art methods in average (peak signal-to-noise ratio) PSNR/(structural similarity) SSIM, and exhibits competitive or somewhat lower PSNR/SSIM performance compared with the others.Keywords
Funding Information
- End Run Project 2015 within the Ministry of Science, ICT and Future Planning through the Korean Government (N01150563)
This publication has 32 references indexed in Scilit:
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Jointly Optimized Regressors for Image Super‐resolutionComputer Graphics Forum, 2015
- Anchored Neighborhood Regression for Fast Example-Based Super-Resolution2013
- Real-time super-resolution for digital zooming using finite kernel-based edge orientation estimation and truncated image restoration2013
- An Efficient Selective Perceptual-Based Super-Resolution EstimatorIEEE Transactions on Image Processing, 2011
- Real-Time Artifact-Free Image UpscalingIEEE Transactions on Image Processing, 2011
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics2002
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- Cubic convolution interpolation for digital image processingIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981