Area- and Energy-Efficient STDP Learning Algorithm for Spiking Neural Network SoC
Open Access
- 2 December 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 216922-216932
Abstract
Recently, spiking neural networks have gained attention owing to their energy efficiency. All-to-all spike-time dependent plasticity is a popular learning algorithm for spiking neural networks because it is suitable for nondifferentiable spike event-based learning and requires fewer computations than back-propagation-based algorithms. However, the hardware implementation of all-to-all spike-time dependent plasticity is limited by the large storage area required for spike history and large energy consumption caused by frequent memory access. We propose a time-step scaled spike-time dependent plasticity to reduce the storage area required for spike history by reducing the area of the spike-time dependent plasticity learning circuit by 60% and a post-neuron spike-referred spike-time dependent plasticity to reduce the energy consumption by 99.1% by efficiently accessing the memory while learning. The accuracy of Modified National Institute of Standards and Technology image classification degraded by less than 2% when both time-step scaled spike-time dependent plasticity and post-neuron spike-referred spike-time dependent plasticity were applied. Thus, the proposed hardware-friendly spike-time dependent plasticity algorithms make all-to-all spike-time dependent plasticity implementable in more compact areas while reducing energy consumption and experiencing insignificant accuracy degradation.Keywords
Funding Information
- National Research Foundation of Korea
- Korea government (2017R1A2B2006679, 2020M3F3A2A01081918)
This publication has 27 references indexed in Scilit:
- Task Placement Across Multiple Public Clouds With Deadline Constraints for Smart FactoryIEEE Access, 2017
- Fast R-CNN2015
- Unsupervised learning of digit recognition using spike-timing-dependent plasticityFrontiers in Computational Neuroscience, 2015
- Memory and Information Processing in Neuromorphic SystemsProceedings of the IEEE, 2015
- Immunity to Device Variations in a Spiking Neural Network With Memristive NanodevicesIEEE Transactions on Nanotechnology, 2013
- Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike ShiftingNeural Computation, 2010
- Spike timing dependent synaptic plasticity in biological systemsBiological Cybernetics, 2002
- Spiking Neuron Models2002
- Synaptic plasticity: taming the beastNature Neuroscience, 2000
- Competitive Hebbian learning through spike-timing-dependent synaptic plasticityNature Neuroscience, 2000