A Memristor-Based Learning Engine for Synaptic Trace-Based Online Learning
- 30 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Circuits and Systems
- Vol. 17 (5) , 1153-1165
Abstract
The memristor has been extensively used to facilitate the synaptic online learning of brain-inspired spiking neural networks (SNNs). However, the current memristor-based work can not support the widely used yet sophisticated trace-based learning rules, including the trace-based Spike-Timing-Dependent Plasticity (STDP) and the Bayesian Confidence Propagation Neural Network (BCPNN) learning rules. This paper proposes a learning engine to implement trace-based online learning, consisting of memristor-based blocks and analog computing blocks. The memristor is used to mimic the synaptic trace dynamics by exploiting the nonlinear physical property of the device. The analog computing blocks are used for the addition, multiplication, logarithmic and integral operations. By organizing these building blocks, a reconfigurable learning engine is architected and realized to simulate the STDP and BCPNN online learning rules, using memristors and 180 nm analog CMOS technology. The results show that the proposed learning engine can achieve energy consumption of 10.61 pJ and 51.49 pJ per synaptic update for the STDP and BCPNN learning rules, respectively, with a 147.03× and 93.61× reduction compared to the 180 nm ASIC counterparts, and also a 9.39× and 5.63× reduction compared to the 40 nm ASIC counterparts. Compared with the state-of-the-art work of Loihi and eBrainII, the learning engine can reduce the energy per synaptic update by 11.31× and 13.13× for trace-based STDP and BCPNN learning rules, respectively.Keywords
Funding Information
- Key-Area Research and Development Program of Guangdong Province (2021B0909060002)
- NSFC-STINT joint project (62011530132)
- National Natural Science Foundation of China (62076066, 92164301)
- Shanghai Municipal Science and Technology Major (2021SHZDZX0103)
This publication has 47 references indexed in Scilit:
- Unsupervised learning of digit recognition using spike-timing-dependent plasticityFrontiers in Computational Neuroscience, 2015
- VTEAM: A General Model for Voltage-Controlled MemristorsIEEE Transactions on Circuits and Systems II: Express Briefs, 2015
- Reducing the computational footprint for real-time BCPNN learningFrontiers in Neuroscience, 2015
- Synaptic and nonsynaptic plasticity approximating probabilistic inferenceFrontiers in Synaptic Neuroscience, 2014
- A ferroelectric memristorNature Materials, 2012
- Spike Timing–Dependent Plasticity: A Hebbian Learning RuleAnnual Review of Neuroscience, 2008
- Phenomenological models of synaptic plasticity based on spike timingBiological Cybernetics, 2008
- The missing memristor foundNature, 2008
- Optimization Using Simulated AnnealingJournal of the Royal Statistical Society: Series D (The Statistician), 1995
- A ONE-LAYER FEEDBACK ARTIFICIAL NEURAL NETWORK WITH A BAYESIAN LEARNING RULEInternational Journal of Neural Systems, 1989