Homeostatic synaptic normalization optimizes learning in network models of neural population codes
Preprint
- 1 July 2024
- preprint
- Published by eLife Sciences Publications, Ltd in eLife preprints
- Vol. 13
Abstract
Studying and understanding the code of large neural populations hinge on accurate statistical models of population activity. A novel class of models, based on learning to weigh sparse nonlinear Random Projections (RP) of the population, has demonstrated high accuracy, efficiency, and scalability. Importantly, these RP models have a clear and biologically-plausible implementation as shallow neural networks. We present a new class of RP models that are learned by optimizing the randomly selected sparse projections themselves. This “reshaping” of projections is akin to changing synaptic connections in just one layer of the corresponding neural circuit model. We show that Reshaped RP models are more accurate and efficient than the standard RP models in recapitulating the code of tens of cortical neurons from behaving monkeys. Incorporating more biological features and utilizing synaptic normalization in the learning process, results in even more efficient and accurate models. Remarkably, these models exhibit homeostasis in firing rates and total synaptic weights of projection neurons. We further show that these sparse homeostatic reshaped RP models outperform fully connected neural network models. Thus, our new scalable, efficient, and highly accurate population code models are not only biologically-plausible but are actually optimized due to their biological features. These findings suggest a dual functional role of synaptic normalization in neural circuits: maintaining spiking and synaptic homeostasis while concurrently optimizing network performance and efficiency in encoding information and learning.Keywords
All Related Versions
This publication has 53 references indexed in Scilit:
- Reprogramming the topology of the nociceptive circuit in C. elegans reshapes sexual behaviorCurrent Biology, 2022
- Drawing inspiration from biological dendrites to empower artificial neural networksCurrent Opinion in Neurobiology, 2021
- Analyzing biological and artificial neural networks: challenges with opportunities for synergy?Current Opinion in Neurobiology, 2019
- Cracking the Neural Code for Sensory Perception by Combining Statistics, Intervention, and BehaviorNeuron, 2017
- Towards the design principles of neural population codesCurrent Opinion in Neurobiology, 2016
- Modeling the Dynamic Interaction of Hebbian and Homeostatic PlasticityNeuron, 2014
- Dynamics of Neural Population Responses in Prefrontal Cortex Indicate Changes of Mind on Single TrialsCurrent Biology, 2014
- Firing Rate Homeostasis in Visual Cortex of Freely Behaving RodentsNeuron, 2013
- Synaptic Scaling and Homeostatic Plasticity in the Mouse Visual Cortex In VivoNeuron, 2013
- The Self-Tuning Neuron: Synaptic Scaling of Excitatory SynapsesCell, 2008