Low-Latency Machine Vision Based on a Neuromorphic Vision Sensor
Open Access
- 27 June 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (13) , 2828
Abstract
Low-latency visual perception is essential for interactive machine vision on edge AI devices, but conventional frame-based image sensors impose frame period delays and generate dense image data that increase memory bandwidth and processing latency. Although Dynamic Vision Sensors (DVSs) are known to provide low latency, sparse output, and high dynamic range, these sensor-level properties do not automatically translate into practical application-level latency reduction on resource-constrained edge platforms. This paper presents a latency-driven sensing algorithm co-design approach for DVS-based low-latency machine vision. The main objective is to connect DVS sensor-level characteristics, event representations, task-dependent processing flows, and measured response times on mobile application processors. We first analyze latency requirements for three representative edge AI applications (i.e., person detection, gesture recognition, and Simultaneous Localization and Mapping (SLAM)), which correspond to different latency regimes and processing structures. We then describe the DVS operating principle, pixel-level event latency, and readout latency, showing how asynchronous event generation reduces sensing delay and suppresses redundant static background information before algorithmic processing. In contrast to prior event camera studies that mainly optimize a single task or a specific event representation, this work evaluates three task-specific event processing systems on mobile processors. Person detection achieves 92 ms processing latency on Exynos 7570, gesture recognition based on event-driven 4-DoF motion estimation achieves 20 ms latency on Exynos 5422, and SLAM achieves 15.9 ms latency on Snapdragon 845. These results satisfy the practical latency targets of the corresponding applications and demonstrate that DVS-based sensing can provide not only sensor-level speed advantages but also system-level latency benefits for AIoT, mobile, robotics, and AR/VR machine vision systems.Keywords
Funding Information
- Samsung
This publication has 32 references indexed in Scilit:
- Low-latency automotive vision with event camerasNature, 2024
- Identifying Causes of and Solutions for Cybersickness in Immersive Technology: Reformulation of a Research and Development AgendaInternational Journal of Human–Computer Interaction, 2020
- Event-Based Vision: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- Toward Low-Latency and Ultra-Reliable Virtual RealityIEEE Network, 2018
- Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception AgeIEEE Transactions on Robotics, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- Real-Time Gesture Interface Based on Event-Driven Processing From Stereo Silicon RetinasIEEE Transactions on Neural Networks and Learning Systems, 2014
- Speed of processing in the human visual systemNature, 1996
- Perceived order in different sense modalities.Journal of Experimental Psychology, 1961