LC-TTFS: Towards Lossless Network Conversion for Spiking Neural Networks with TTFS Coding
Authors:
- Qu YangQYQu Yang
- Malu ZhangMZMalu Zhang
- Jibin WuJWJibin Wu
- Kay Chen TanKTKay Chen Tan
- Haizhou LiHLHaizhou Li
Preprint
Abstract
The biological neurons use precise spike times, in addition to the spike firing rate, to communicate with each other. The time-to-first-spike (TTFS) coding is inspired by such biological observation. However, there is a lack of effective solutions for training TTFS-based spiking neural network (SNN). In this paper, we put forward a simple yet effective network conversion algorithm, which is referred to as LC-TTFS, by addressing two main problems that hinder an effective conversion from a high-performance artificial neural network (ANN) to a TTFS-based SNN. We show that our algorithm can achieve a near-perfect mapping between the activation values of an ANN and the spike times of an SNN on a number of challenging AI tasks, including image classification, image reconstruction, and speech enhancement. With TTFS coding, we can achieve up to orders of magnitude saving in computation over ANN and other rate-based SNNs. The study, therefore, paves the way for deploying ultra-low-power TTFS-based SNNs on power-constrained edge computing platforms.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- The Intel neuromorphic DNS challengeNeuromorphic Computing and Engineering, 2023
- BS4NN: Binarized Spiking Neural Networks with Temporal Coding and LearningNeural Processing Letters, 2021
- Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-Based Optimization to Spiking Neural NetworksIEEE Signal Processing Magazine, 2019
- Mastering the game of Go without human knowledgeNature, 2017
- Convolutional networks for fast, energy-efficient neuromorphic computingProceedings of the National Academy of Sciences, 2016
- Evaluation of Objective Quality Measures for Speech EnhancementIEEE Transactions on Audio, Speech, and Language Processing, 2007
- The tempotron: a neuron that learns spike timing–based decisionsNature Neuroscience, 2006
- Spike-based strategies for rapid processingNeural Networks, 2001
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Networks of spiking neurons: The third generation of neural network modelsNeural Networks, 1997