Robust super-resolution by fusion of interpolated frames for color and grayscale images
Authors:
Open Access
- 24 April 2015
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Physics
- Vol. 3
Abstract
Multi-frame super-resolution (SR) processing seeks to overcome undersampling issues that can lead to undesirable aliasing artifacts. The key to effective multi-frame SR is accurate subpixel inter-frame registration. This accurate registration is challenging when the motion does not obey a simple global translational model and may include local motion. SR processing is further complicated when the camera uses a division-of-focal-plane (DoFP) sensor, such as the Bayer color filter array. Various aspects of these SR challenges have been previously investigated. Fast SR algorithms tend to have difficulty accommodating complex motion and DoFP sensors. Furthermore, methods that can tolerate these complexities tend to be iterative in nature and may not be amenable to real-time processing. In this paper, we present a new fast approach for performing SR in the presence of these challenging imaging conditions. We refer to the new approach as Fusion of Interpolated Frames (FIF) SR. The FIF SR method decouples the demosaicing, interpolation, and restoration steps to simplify the algorithm. Frames are first individually demosaiced and interpolated to the desired resolution. Next, FIF uses a novel weighted sum of the interpolated frames to fuse them into an improved resolution estimate. Finally, restoration is applied to deconvolve the modeled system PSF. The proposed FIF approach has a lower computational complexity than most iterative methods, making it a candidate for real-time implementation. We provide a detailed description of the FIF SR method and show experimental results using synthetic and real datasets in both constrained and complex imaging scenarios. The experiments include airborne grayscale imagery and Bayer color array images with affine background motion plus local motion.Keywords
This publication has 29 references indexed in Scilit:
- Fast super-resolution using an adaptive Wiener filter with robustness to local motionOptics Express, 2012
- Fast super-resolution with affine motion using an adaptive Wiener filter and its application to airborne imagingOptics Express, 2011
- Robust video super resolution algorithm using measurement validation method and scene change detectionEURASIP Journal on Advances in Signal Processing, 2011
- Robust Color Image Superresolution: An Adaptive M-Estimation FrameworkEURASIP Journal on Image and Video Processing, 2008
- Partition-based interpolation for color filter array demosaicking and super-resolution reconstructionOptical Engineering, 2005
- Effective color interpolation in CCD color filter arrays using signal correlationIEEE Transactions on Circuits and Systems for Video Technology, 2003
- Super-resolution image reconstruction: a technical overviewIEEE Signal Processing Magazine, 2003
- Color plane interpolation using alternating projectionsIEEE Transactions on Image Processing, 2002
- Demosaicing: image reconstruction from color CCD samplesIEEE Transactions on Image Processing, 1999
- Color gamut transform pairsACM SIGGRAPH Computer Graphics, 1978