Brain-inspired global-local learning incorporated with neuromorphic computing
Authors:
Open Access
- 10 January 2022
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 13 (1) , 1-14
Abstract
There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs to fully exploit its advantages. Here, we present a neuromorphic global-local synergic learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods. We further implement the model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and prove that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm.Keywords
All Related Versions
This publication has 46 references indexed in Scilit:
- Matching Recall and Storage in Sequence Learning with Spiking Neural NetworksThe Journal of Neuroscience, 2013
- Ischemia-induced synaptic plasticity drives sustained expression of calcium-permeable AMPA receptors in the hippocampusNeuropharmacology, 2013
- Bidirectional associative memoriesACM Computing Surveys, 2013
- A neoHebbian framework for episodic memory; role of dopamine-dependent late LTPTrends in Neurosciences, 2011
- Stably maintained dendritic spines are associated with lifelong memoriesNature, 2009
- A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to BiofeedbackPLOS Computational Biology, 2008
- Metalearning and neuromodulationNeural Networks, 2002
- Rank Order Coding1998
- Hierarchical optimization: An introductionAnnals of Operations Research, 1992
- Bidirectional associative memoriesIEEE Transactions on Systems, Man, and Cybernetics, 1988