Event Camera Guided Visual Media Restoration & 3D Reconstruction: A Survey
Preprint
Abstract
Event camera sensors are bio-inspired sensors which asynchronously capture per-pixel brightness changes and output a stream of events encoding the polarity, location and time of these changes. These systems are witnessing rapid advancements as an emerging field, driven by their low latency, reduced power consumption, and ultra-high capture rates. This survey explores the evolution of fusing event-stream captured with traditional frame-based capture, highlighting how this synergy significantly benefits various video restoration and 3D reconstruction tasks. The paper systematically reviews major deep learning contributions to image/video enhancement and restoration, focusing on two dimensions: temporal enhancement (such as frame interpolation and motion deblurring) and spatial enhancement (including super-resolution, low-light and HDR enhancement, and artifact reduction). This paper also explores how the 3D reconstruction domain evolves with the advancement of event driven fusion. Diverse topics are covered, with in-depth discussions on recent works for improving visual quality under challenging conditions. Additionally, the survey compiles a comprehensive list of openly available datasets, enabling reproducible research and benchmarking. By consolidating recent progress and insights, this survey aims to inspire further research into leveraging event camera systems, especially in combination with deep learning, for advanced visual media restoration and enhancement.Keywords
All Related Versions
This publication has 59 references indexed in Scilit:
- Recent Event Camera Innovations: A Survey2025
- CMTA: Cross-Modal Temporal Alignment for Event-Guided Video Deblurring2024
- Neural image re-exposureComputer Vision and Image Understanding, 2024
- Event-guided Deblurring of Unknown Exposure Time Videos2022
- Event-Based Fusion for Motion Deblurring with Cross-modal Attention2022
- Image De-occlusion via Event-enhanced Multi-modal Fusion Hybrid NetworkMachine Intelligence Research, 2022
- Continuous-Time Intensity Estimation Using Event Cameras2019
- Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold RegularisationInternational Journal of Computer Vision, 2018
- EMVS: Event-Based Multi-View Stereo—3D Reconstruction with an Event Camera in Real-TimeInternational Journal of Computer Vision, 2017
- High-speed video generation with an event cameraThe Visual Computer, 2017