Robust video super resolution algorithm using measurement validation method and scene change detection
Authors:
Open Access
- 15 November 2011
- journal article
- research article
- Published by Springer Nature in EURASIP Journal on Advances in Signal Processing
- Vol. 2011 (1) , 103
Abstract
Explicit motion estimation is considered a major factor in the performance of classical motion-based super resolution (SR) algorithms. To reconstruct video frames sequentially, we applied a dynamic SR algorithm based on the Kalman recursive estimator. Our approach includes a novel measurement validation process to attain robust image reconstruction results under inexplicit motion estimation. In our method, the suitability for high-resolution pixel estimation is determined by the accuracy of motion estimation. We measured the accuracy of the image registration result using the Mahalanobis distance between the input low-resolution frame and the motion compensated high-resolution estimation. We also incorporate an effective scene change detection method dedicated to the proposed SR approach for minimizing erroneous results when abrupt scene changes occur in the video frames. According to the ratio of well-aligned pixels (i.e., motion is compensated accurately) to the total number of pixels, we are able to detect sudden changes of scene and context in the input video. Representative experiments on synthetic and real video data show robust performance of the proposed algorithm in terms of its reconstruction quality even with errors in the estimated motion.Keywords
This publication has 18 references indexed in Scilit:
- Super-Resolution Without Explicit Subpixel Motion EstimationIEEE Transactions on Image Processing, 2009
- Super Resolution With Probabilistic Motion EstimationIEEE Transactions on Image Processing, 2009
- Generalizing the Nonlocal-Means to Super-Resolution ReconstructionIEEE Transactions on Image Processing, 2008
- A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolutionEURASIP Journal on Advances in Signal Processing, 2006
- Video-to-Video Dynamic Super-Resolution for Grayscale and Color SequencesEURASIP Journal on Advances in Signal Processing, 2006
- Super-resolution image reconstruction: a technical overviewIEEE Signal Processing Magazine, 2003
- Example-based super-resolutionIEEE Computer Graphics and Applications, 2002
- Super-resolution reconstruction of image sequencesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- Restoration of a single superresolution image from several blurred, noisy, and undersampled measured imagesIEEE Transactions on Image Processing, 1997
- Tracking and Data AssociationThe Journal of the Acoustical Society of America, 1990