Sparse Representation-Based Multiple Frame Video Super-Resolution
Authors:
- 22 November 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (2) , 765-781
Abstract
In this paper, we propose two multiple-frame super-resolution (SR) algorithms based on dictionary learning (DL) and motion estimation. First, we adopt the use of video bilevel DL, which has been used for single-frame SR. It is extended to multiple frames by using motion estimation with sub-pixel accuracy. We propose a batch and a temporally recursive multi-frame SR algorithm, which improves over single-frame SR. Finally, we propose a novel DL algorithm utilizing consecutive video frames, rather than still images or individual video frames, which further improves the performance of the video SR algorithms. Extensive experimental comparisons with the state-of-the-art SR algorithms verify the effectiveness of our proposed multiple-frame video SR approach.Keywords
Funding Information
- Samsung DMC Research and Development Center
This publication has 38 references indexed in Scilit:
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- Maximuma PosterioriVideo Super-Resolution Using a New Multichannel Image PriorIEEE Transactions on Image Processing, 2010
- Fast image/video upsamplingACM Transactions on Graphics, 2008
- Regularized high-resolution image reconstruction considering inaccurate motion informationOptical Engineering, 2007
- Super Resolution of Images and VideoSynthesis Lectures on Image, Video, and Multimedia Processing, 2007
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A VQ-based blind image restoration algorithmIEEE Transactions on Image Processing, 2003
- High-resolution images from low-resolution compressed videoIEEE Signal Processing Magazine, 2003
- Super-resolution image reconstruction: a technical overviewIEEE Signal Processing Magazine, 2003
- Determining optical flowArtificial Intelligence, 1981