Cascaded Deep Video Deblurring Using Temporal Sharpness Prior
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3040-3048
Abstract
We present a simple and effective deep convolutional neural network (CNN) model for video deblurring. The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps. It first develops a deep CNN model to estimate optical flow from intermediate latent frames and then restores the latent frames based on the estimated optical flow. To better explore the temporal information from videos, we develop a temporal sharpness prior to constrain the deep CNN model to help the latent frame restoration. We develop an effective cascaded training approach and jointly train the proposed CNN model in an end-to-end manner. We show that exploring the domain knowledge of video deblurring is able to make the deep CNN model more compact and efficient. Extensive experimental results show that the proposed algorithm performs favorably against state-of-the-art methods on the benchmark datasets as well as real-world videos.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Deblurring Images via Dark Channel PriorIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring2017
- Deep Video Deblurring for Hand-Held Cameras2017
- Context Encoders: Feature Learning by Inpainting2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- Segmentation-Free Dynamic Scene Deblurring2014
- Modeling Blurred Video with Layers2014
- Video deblurring for hand-held cameras using patch-based synthesisACM Transactions on Graphics, 2012
- From learning models of natural image patches to whole image restoration2011
- Full-frame video stabilization with motion inpaintingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006