Joint Depth Estimation and Camera Shake Removal from Single Blurry Image
Authors:
- Zhe HuZHZhe Hu
- Li XuLXLi Xu
- Ming-Hsuan YangMYMing-Hsuan Yang
- 1 June 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2893-2900
Abstract
Camera shake during exposure time often results in spatially variant blur effect of the image. The non-uniform blur effect is not only caused by the camera motion, but also the depth variation of the scene. The objects close to the camera sensors are likely to appear more blurry than those at a distance in such cases. However, recent non-uniform deblurring methods do not explicitly consider the depth factor or assume fronto-parallel scenes with constant depth for simplicity. While single image non-uniform deblurring is a challenging problem, the blurry results in fact contain depth information which can be exploited. We propose to jointly estimate scene depth and remove non-uniform blur caused by camera motion by exploiting their underlying geometric relationships, with only single blurry image as input. To this end, we present a unified layer-based model for depth-involved deblurring. We provide a novel layer-based solution using matting to partition the layers and an expectation-maximization scheme to solve this problem. This approach largely reduces the number of unknowns and makes the problem tractable. Experiments on challenging examples demonstrate that both depth and camera shake removal can be well addressed within the unified framework.Keywords
This publication has 23 references indexed in Scilit:
- Non-uniform Motion Deblurring for Bilayer Scenes2013
- Fast Non-uniform Deblurring using Constrained Camera Pose Subspace2012
- Blind deconvolution using a normalized sparsity measure2011
- Image deblurring using inertial measurement sensors2010
- Understanding and evaluating blind deconvolution algorithms2009
- High-quality motion deblurring from a single imageACM Transactions on Graphics, 2008
- Make3D: Learning 3D Scene Structure from a Single Still ImageIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Image and depth from a conventional camera with a coded aperture2007
- Image deblurring with blurred/noisy image pairs2007
- Coded exposure photographyACM Transactions on Graphics, 2006