Sparsity-Aware Hardware-Software Co-Design of Spiking Neural Networks: An Overview
Preprint
Abstract
Spiking Neural Networks (SNNs) are inspired by the sparse and event-driven nature of biological neural processing, and offer the potential for ultra-low-power artificial intelligence. However, realizing their efficiency benefits requires specialized hardware and a co-design approach that effectively leverages sparsity. We explore the hardware-software co-design of sparse SNNs, examining how sparsity representation, hardware architectures, and training techniques influence hardware efficiency. We analyze the impact of static and dynamic sparsity, discuss the implications of different neuron models and encoding schemes, and investigate the need for adaptability in hardware designs. Our work aims to illuminate the path towards embedded neuromorphic systems that fully exploit the computational advantages of sparse SNNs.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- A neuroscience-inspired spiking neural network for EEG-based auditory spatial attention detectionNeural Networks, 2022
- Comparing SNNs and RNNs on neuromorphic vision datasets: Similarities and differencesNeural Networks, 2020
- Sparsity through evolutionary pruning prevents neuronal networks from overfittingNeural Networks, 2020
- Learning what matters: A neural explanation for the sparsity biasInternational Journal of Psychophysiology, 2018
- Energy‐efficient neural information processing in individual neurons and neuronal networksJournal of Neuroscience Research, 2017
- Robust common spatial patterns with sparsityBiomedical Signal Processing and Control, 2016
- Segmentation and Edge Detection Based on Spiking Neural Network ModelNeural Processing Letters, 2010
- Lapicque’s 1907 paper: from frogs to integrate-and-fireBiological Cybernetics, 2007
- The parameters of the stochastic leaky integrate-and-fire neuronal modelJournal of Computational Neuroscience, 2006
- A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic InputBiological Cybernetics, 2006