Generating the Past, Present and Future from a Motion-Blurred Image
Open Access
- 4 December 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 44 (6) , 1-15
Abstract
We seek to answer the question: what can a motion-blurred image reveal about a scene's past, present, and future? Although motion blur obscures image details and degrades visual quality, it also encodes information about scene and camera motion during an exposure. Previous techniques leverage this information to estimate a sharp image from an input blurry one, or to predict a sequence of video frames showing what might have occurred at the moment of image capture. However, they rely on handcrafted priors or network architectures to resolve ambiguities in this inverse problem, and do not incorporate image and video priors on large-scale datasets. As such, existing methods struggle to reproduce complex scene dynamics and do not attempt to recover what occurred before or after an image was taken. Here, we introduce a new technique that repurposes a pre-trained video diffusion model trained on internet-scale datasets to recover videos revealing complex scene dynamics during the moment of capture and what might have occurred immediately into the past or future. Our approach is robust and versatile; it outperforms previous methods for this task, generalizes to challenging in-the-wild images, and supports downstream tasks such as recovering camera trajectories, object motion, and dynamic 3D scene structure. Code and data are available at blur2vid.github.ioKeywords
All Related Versions
This publication has 40 references indexed in Scilit:
- RoFormer: Enhanced transformer with Rotary Position EmbeddingNeurocomputing, 2023
- Animation from Blur: Multi-modal Blur Decomposition with Motion Guidance2022
- RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020
- Motion Deblurring in the Wild2017
- Learning a convolutional neural network for non-uniform motion blur removal2015
- Blind Deblurring Using Internal Patch Recurrence2014
- Blind deconvolution using a normalized sparsity measure2011
- Understanding and evaluating blind deconvolution algorithms2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Blind image deconvolutionIEEE Signal Processing Magazine, 1996