Enabling local learning for generative-replay-based continual learning with a recurrent model of the insect memory center
Open Access
- 28 August 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Abstract
Continual learning without catastrophic forgetting of previous experiences is an open general challenge for artificial neural networks, but is especially under-explored for artificial neural networks suitable to implement on neuromorphic platforms. An algorithmic understanding of how continual learning occurs in biological neural networks can inform solutions for artificial neural networks, especially in neuromorphic platforms whose biomimetic computing architectures lend themselves to more biofidelic algorithms. In this work, we derive an approach for generative-replay-based continual learning with a three-factor local learning rule based on recurrent connectivity in the insect's memory center, and characterize the model with a CIFAR-100 class incremental continual learning task. First, we investigate the properties of the model's internal representations and find that the high dimensional sparse representations enable this form of generative replay, and that these representations can be binary as required on spiking neuromorphic platforms with little detriment to model performance. Next, we derive a three-factor local learning rule by introducing simplifying assumptions to network updates from error backpropagation optimization which makes the learning rule biologically plausible (i.e., without weight transport) and amenable to neuromorphic implementation. Finally, we find that these simplifications enhance performance during gradient-based optimization for continual learning and when implemented locally achieve this increased performance. Overall, the outcomes of this work can inform a more detailed understanding for continual learning in this biological circuit, as well as introduce general approaches for neuromorphic continual learning.Keywords
This publication has 16 references indexed in Scilit:
- A review of learning in biologically plausible spiking neural networksNeural Networks, 2020
- Continual lifelong learning with neural networks: A reviewNeural Networks, 2019
- Neuromodulated Synaptic Plasticity on the SpiNNaker Neuromorphic SystemFrontiers in Neuroscience, 2018
- Loihi: A Neuromorphic Manycore Processor with On-Chip LearningIEEE Micro, 2018
- A neural algorithm for a fundamental computing problemScience, 2017
- Optimal Degrees of Synaptic ConnectivityNeuron, 2017
- Reward signal in a recurrent circuit drives appetitive long-term memory formationeLife, 2015
- Sparseness and Expansion in Sensory RepresentationsNeuron, 2014
- Random convergence of olfactory inputs in the Drosophila mushroom bodyNature, 2013
- Mushroom body memoir: from maps to modelsNature Reviews Neuroscience, 2003