A 1.1 μJ/Inference Binary Spiking Neural Network Accelerator for DVS Gesture Recognition
- 18 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 73 (2) , 1093-1106
Abstract
Dynamic vision sensors (DVS) are bioinspired sensors that can generate sparse data streams with low latency, low power consumption and high dynamic range. Spiking neural networks (SNNs), which are inspired by biological brains, are event-based models, and therefore they can be used to process the binary data streams produced by such sensors naturally. However, SNN accelerators usually require more memory and longer time for inference, due to the extra time dimension in SNNs. In this paper, an energy efficient binary spiking neural network (BSNN) accelerator for DVS gesture recognition is proposed with algorithm and hardware codesign. We integrate the binary neural network (BNN) training method into SNN to directly train a BSNN model, which significantly reduces memory consumption. A temporal pooling (TP) layer is further proposed to reduce the time steps in SNNs while maintaining competitive accuracy. The proposed BSNN accelerator can achieve high parallelism with high resource utilization, and the sparsity of input spikes is utilized to further reduce power consumption. The proposed BSNN model achieves an accuracy of 95.49% on IBM DVS Gesture dataset. The implementation results show that the BSNN accelerator can achieve 38.2k inference per second with $1.1~\mu $ J/inference energy consumption and 216.9 TOPS/W energy efficiency.Keywords
Funding Information
- Joint Funds of the National Nature Science Foundation of China (U21B2032)
- National Key Research and Development Program of China (2021YFB3600104)
- National Key Research and Development Program of China (2023YFB2806802)
This publication has 35 references indexed in Scilit:
- SciDVS: A Scientific Event Camera with 1.7% Temporal Contrast Sensitivity at 0.7 lux2024
- Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks2023
- Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks2021
- VSA: Reconfigurable Vectorwise Spiking Neural Network Accelerator2021
- An Efficient Spiking Neural Network for Recognizing Gestures with a DVS Camera on the Loihi Neuromorphic Processor2020
- Forward and Backward Information Retention for Accurate Binary Neural Networks2020
- SpinalFlow: An Architecture and Dataflow Tailored for Spiking Neural Networks2020
- Towards spike-based machine intelligence with neuromorphic computingNature, 2019
- A Low Power, Fully Event-Based Gesture Recognition System2017
- A quantitative description of membrane current and its application to conduction and excitation in nerveBulletin of Mathematical Biology, 1990