Freehand HDR Imaging of Moving Scenes with Simultaneous Resolution Enhancement
- 28 April 2011
- journal article
- Published by Wiley in Computer Graphics Forum
- Vol. 30 (2) , 405-414
Abstract
Despite their high popularity, common high dynamic range (HDR) methods are still limited in their practical applicability: They assume that the input images are perfectly aligned, which is often violated in practise. Our paper does not only free the user from this unrealistic limitation, but even turns the missing alignment into an advantage: By exploiting the multiple exposures, we can create a super‐resolution image. The alignment step is performed by a modern energy‐based optic flow approach that takes into account the varying exposure conditions. Moreover, it produces dense displacement fields with subpixel precision. As a consequence, our approach can handle arbitrary complex motion patterns, caused by severe camera shake and moving objects. Additionally, it benefits from several advantages over existing strategies: (i) It is robust under outliers (noise, occlusions, saturation problems) and allows for sharp discontinuities in the displacement field. (ii) The alignment step neither requires camera calibration nor knowledge of the exposure times. (iii) It can be efficiently implemented on CPU and GPU architectures. After the alignment is performed, we use the obtained subpixel accurate displacement fields as input for an energy‐based, joint super‐resolution and HDR (SR‐HDR) approach. It introduces robust data terms and anisotropic smoothness terms in the SR‐HDR literature. Our experiments with challenging real world data demonstrate that these novelties are pivotal for the favourable performance of our approach.Keywords
This publication has 19 references indexed in Scilit:
- Exposure Fusion: A Simple and Practical Alternative to High Dynamic Range PhotographyComputer Graphics Forum, 2009
- Automatic High-Dynamic Range Image Generation for Dynamic ScenesIEEE Computer Graphics and Applications, 2008
- High Dynamic Range Image Reconstruction with Spatial Resolution EnhancementThe Computer Journal, 2007
- Reconstruction of a High Dynamic Range and High Resolution Image from a Multisampled Image Sequence2007
- A Multigrid Platform for Real-Time Motion Computation with Discontinuity-Preserving Variational MethodsInternational Journal of Computer Vision, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Video matchingACM Transactions on Graphics, 2004
- High dynamic range videoACM Transactions on Graphics, 2003
- Super-resolution image reconstruction: a technical overviewIEEE Signal Processing Magazine, 2003
- Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held ExposuresJournal of Graphics Tools, 2003