Removing Camera Shake via Weighted Fourier Burst Accumulation
Open Access
- 9 June 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 24 (11) , 3293-3307
Abstract
Numerous recent approaches attempt to remove image blur due to camera shake, either with one or multiple input images, by explicitly solving an inverse and inherently ill-posed deconvolution problem. If the photographer takes a burst of images, a modality available in virtually all modern digital cameras, we show that it is possible to combine them to get a clean sharp version. This is done without explicitly solving any blur estimation and subsequent inverse problem. The proposed algorithm is strikingly simple: it performs a weighted average in the Fourier domain, with weights depending on the Fourier spectrum magnitude. The method can be seen as a generalization of the align and average procedure, with a weighted average, motivated by hand-shake physiology and theoretically supported, taking place in the Fourier domain. The method's rationale is that camera shake has a random nature, and therefore, each image in the burst is generally blurred differently. Experiments with real camera data, and extensive comparisons, show that the proposed Fourier burst accumulation algorithm achieves state-of-the-art results an order of magnitude faster, with simplicity for on-board implementation on camera phones. Finally, we also present experiments in real high dynamic range (HDR) scenes, showing how the method can be straightforwardly extended to HDR photography.Keywords
All Related Versions
Funding Information
- National Science Foundation
- U.S. Army Research Office
- National Geospatial-Intelligence Agency
- Air Force Office of Scientific Research, Arlington, VA, USA
- Office of Naval Research, Arlington, VA, USA
This publication has 34 references indexed in Scilit:
- Photographing Paintings by Image FusionSIAM Journal on Imaging Sciences, 2012
- Fast motion deblurringACM Transactions on Graphics, 2009
- Blind motion deblurring using multiple imagesJournal of Computational Physics, 2009
- High-quality motion deblurring from a single imageACM Transactions on Graphics, 2008
- Image deblurring with blurred/noisy image pairsACM Transactions on Graphics, 2007
- Lucky imaging: high angular resolution imaging in the visible from the groundAstronomy & Astrophysics, 2006
- Two motion-blurred images are better than onePattern Recognition Letters, 2005
- Blind image deconvolutionIEEE Signal Processing Magazine, 1996
- Random sample consensusCommunications of the ACM, 1981
- Probability of getting a lucky short-exposure image through turbulence*Journal of the Optical Society of America, 1978