Extreme Sparsity in Hodgkin-Huxley Spiking Neural Networks
- 15 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 85-94
Abstract
Spiking neural networks present a new generation of artificial neural networks utilizing binary data representation for large energy, memory, and latency savings due to widespread sparsity. At the same time, they are at the focal point for neuroscientific communities, enabling biologically plausible simulations of systems with a learning capacity. In this work, we present spiking neural networks based on an implementation of a biologically highly plausible neuron model, the Hodgkin-Huxley model. The networks are trained via backpropagation through time using surrogate gradients. They show competitive performances on various neuromorphic datasets while displaying a spiking activity lower by up to two orders of magnitude compared to similar spiking neural networks based on the conventional leaky integrate-and-fire neuron model. Additionally, this work paves the way toward higher biological plausibility in high-performance computational neuroscience by enabling in-depth looks at the underlying dynamics of Hodgkin-Huxley neurons as part of larger operating networks.Keywords
Funding Information
- Ministry of Education
This publication has 33 references indexed in Scilit:
- The Hodgkin–Huxley neuron model for motion detection in image sequencesNeural Computing and Applications, 2021
- Deep learning in spiking neural networksNeural Networks, 2019
- STDP-based spiking deep convolutional neural networks for object recognitionNeural Networks, 2018
- Neuronal Dynamics2014
- A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic InputBiological Cybernetics, 2006
- On the computational power of circuits of spiking neuronsJournal of Computer and System Sciences, 2004
- Playing the Devil's advocate: is the Hodgkin–Huxley model useful?Trends in Neurosciences, 2002
- Error-backpropagation in temporally encoded networks of spiking neuronsNeurocomputing, 2002
- The Hodgkin-Huxley theory of the action potentialNature Neuroscience, 2000
- Networks of spiking neurons: The third generation of neural network modelsNeural Networks, 1997