E-detector: Asynchronous Spatio-temporal for Event-based Object Detection in Intelligent Transportation System
Open Access
- 27 September 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 20 (2) , 1-20
Abstract
In intelligent transportation systems, various sensors, including radar and conventional frame cameras, are used to improve system robustness in various challenging scenarios. An event camera is a novel bio-inspired sensor that has attracted the interest of several researchers. It provides a form of neuromorphic vision to capture motion information asynchronously at high speeds. Thus, it possesses advantages for intelligent transportation systems that conventional frame cameras cannot match, such as high temporal resolution, high dynamic range, as well as sparse and minimal motion blur. Therefore, this study proposes an E-detector based on event cameras that asynchronously detect moving objects. The main innovation of our framework is that the spatiotemporal domain of the event camera can be adjusted according to different velocities and scenarios. It overcomes the inherent challenges that traditional cameras face when detecting moving objects in complex environments, such as high speed, complex lighting, and motion blur. Moreover, our approach adopts filter models and transfer learning to improve the performance of event-based object detection. Experiments have shown that our method can detect high-speed moving objects better than conventional cameras using state-of-the-art detection algorithms. Thus, our proposed approach is extremely competitive and extensible, as it can be extended to other scenarios concerning high-speed moving objects. The study findings are expected to unlock the potential of event cameras in intelligent transportation system applications.Keywords
Funding Information
- Science and Technology Development Fund (FDCT) of Macau (0016/2019/A1)
This publication has 37 references indexed in Scilit:
- Moving-Object Detection From Consecutive Stereo Pairs Using Slanted Plane SmoothingIEEE Transactions on Intelligent Transportation Systems, 2017
- SSD: Single Shot MultiBox Detector2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision SensorIEEE Journal of Solid-State Circuits, 2014
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Event-based 3D reconstruction from neuromorphic retinasNeural Networks, 2013
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- A 64x64 aer logarithmic temporal derivative silicon retina2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004