Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks
Authors:
Open Access
- 7 October 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-13
Abstract
The architecture design and multi-scale learning principles of the human brain that evolved over hundreds of millions of years are crucial to realizing human-like intelligence. Spiking neural network based Liquid State Machine (LSM) serves as a suitable architecture to study brain-inspired intelligence because of its brain-inspired structure and the potential for integrating multiple biological principles. Existing researches on LSM focus on different certain perspectives, including high-dimensional encoding or optimization of the liquid layer, network architecture search, and application to hardware devices. There is still a lack of in-depth inspiration from the learning and structural evolution mechanism of the brain. Considering these limitations, this paper presents a novel LSM learning model that integrates adaptive structural evolution and multi-scale biological learning rules. For structural evolution, an adaptive evolvable LSM model is developed to optimize the neural architecture design of liquid layer with separation property. For brain-inspired learning of LSM, we propose a dopamine-modulated Bienenstock-Cooper-Munros (DA-BCM) method that incorporates global long-term dopamine regulation and local trace-based BCM synaptic plasticity. Comparative experimental results on different decision-making tasks show that introducing structural evolution of the liquid layer, and the DA-BCM regulation of the liquid layer and the readout layer could improve the decision-making ability of LSM and flexibly adapt to rule reversal. This work is committed to exploring how evolution can help to design more appropriate network architectures and how multi-scale neuroplasticity principles coordinated to enable the optimization and learning of LSMs for relatively complex decision-making tasks.Keywords
All Related Versions
Funding Information
- The National Natural Science Foundation of China (62106261)
- the National Key Research and Development Program (2020AAA0107800)
- the Strategic Priority Research Program of the Chinese Academy of Sciences (XDB32070100)
This publication has 54 references indexed in Scilit:
- High-cost, high-capacity backbone for global brain communicationProceedings of the National Academy of Sciences, 2012
- Simple models of human brain functional networksProceedings of the National Academy of Sciences, 2012
- Generating Coherent Patterns of Activity from Chaotic Neural NetworksNeuron, 2009
- A Simple Rule for Axon Outgrowth and Synaptic Competition Generates Realistic Connection Lengths and Filling FractionsCerebral Cortex, 2009
- Revealing Modular Architecture of Human Brain Structural Networks by Using Cortical Thickness from MRICerebral Cortex, 2008
- Edge of chaos and prediction of computational performance for neural circuit modelsNeural Networks, 2007
- Bidirectional Parallel Fiber Plasticity in the Cerebellum under Climbing Fiber ControlNeuron, 2004
- Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on PerturbationsNeural Computation, 2002
- Long Short-Term MemoryNeural Computation, 1997
- A Neural Substrate of Prediction and RewardScience, 1997