Revisiting the role of synaptic plasticity and network dynamics for fast learning in spiking neural networks
Preprint
Abstract
Spike-based neural network models have so far not been able to reproduce the capability of the brain to learn from very few, often even from just a single example. We show that this deficiency of models disappears if one allows synaptic weights to store priors and other information that optimize the learning process, while using the network state to quickly absorb information from new examples. For that, it suffices to include biologically realistic neurons with spike frequency adaptation in the neural network model, and to optimize the learning process through meta-learning. We demonstrate this on a variety of tasks, including fast learning and deletion of attractors, adaptation of motor control to changes in the body, and solving the Morris water maze task – a paradigm for fast learning of navigation to a new goal. Significance Statement It has often been conjectured that STDP or other rules for synaptic plasticity can only explain some of the learning capabilities of brains. In particular, learning a new task from few trials is likely to engage additional mechanisms. Results from machine learning show that artificial neural networks can learn from few trials by storing information about them in their network state, rather than encoding them in synaptic weights. But these machine learning methods require neural networks with biologically unrealistic LSTM (Long Short Term Memory) units. We show that biologically quite realistic models for neural networks of the brain can exhibit similar capabilities. In particular, these networks are able to store priors that enable learning from very few examples.Keywords
This publication has 25 references indexed in Scilit:
- Sleep-dependent memory triage: evolving generalization through selective processingNature Neuroscience, 2013
- Can proprioceptive training improve motor learning?Journal of Neurophysiology, 2012
- Learning latent structure: carving nature at its jointsCurrent Opinion in Neurobiology, 2010
- Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods FailPLOS Computational Biology, 2009
- Neural basis of sensorimotor learning: modifying internal modelsCurrent Opinion in Neurobiology, 2008
- A Universal Model for Spike-Frequency AdaptationNeural Computation, 2003
- Memory from the dynamics of intrinsic membrane currentsProceedings of the National Academy of Sciences, 1996
- Developments of a water-maze procedure for studying spatial learning in the ratJournal of Neuroscience Methods, 1984
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- The formation of learning sets.Psychological Review, 1949