Event Temporal Upsampling through High Frame Rate Brightness Changes Estimation
- 22 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. PP (10518215) , 1
Abstract
Event cameras offer unique advantages such as high temporal resolution and low power consumption. However, under slow-motion or low-light scenarios, the resulting event streams are often sparse, limiting the performance of event-based vision algorithms. In this paper, we propose a novel temporal upsampling framework that enhances the temporal resolution of sparse events by estimating high-frame-rate brightness changes. Our method first reconstructs long-term brightness changes from sparse input events using a neural network, then optimizes short-term high-frame-rate brightness variations through a spatiotemporal smoothness and sparsity-constrained model. Following the generation principle of event cameras, new events are synthesized when estimated brightness changes exceed the firing threshold. To evaluate the effectiveness of our method, we construct a temporal upsampling dataset and introduce two event-based metrics to directly assess the quality of upsampled events. Extensive experiments demonstrate that our approach can generate denser and more informative events, significantly enhancing the performance of downstream tasks, including image reconstruction, optical flow estimation, and object detection in sparse conditions.Keywords
Funding Information
- National Natural Science Foun- dation of China (61825101)
- National Natural Science Foun- dation of China (62027804)
- National Natural Science Foun- dation of China (62088102)
- Beijing Major Science and Technology Project (Z191100010618003)
This publication has 59 references indexed in Scilit:
- E-RAFT: Dense Optical Flow from Event Cameras2021
- Reducing the Sim-to-Real Gap for Event Cameras2020
- A Differentiable Recurrent Surface for Asynchronous Event-Based Data2020
- Super-resolution of spatiotemporal event-stream imageNeurocomputing, 2019
- EMVS: Event-Based Multi-View Stereo—3D Reconstruction with an Event Camera in Real-TimeInternational Journal of Computer Vision, 2017
- Accelerating the Super-Resolution Convolutional Neural Network2016
- Microsoft COCO: Common Objects in Context2014
- A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomographyJournal of Structural Biology, 2013
- A self-correcting point processStochastic Processes and their Applications, 1979
- Spectra of some self-exciting and mutually exciting point processesBiometrika, 1971