Indistinguishable Synapses Lead to Sparse Networks
Author:
- 1 March 2018
- journal article
- research article
- Published by MIT Press in Neural Computation
- Vol. 30 (3) , 708-722
Abstract
Neurons integrate information from many neighbors when they process information. Inputs to a given neuron are thus indistinguishable from one another. Under the assumption that neurons maximize their information storage, indistinguishability is shown to place a strong constraint on the distribution of strengths between neurons. The distribution of individual synapse strengths is found to follow a modified Boltzmann distribution with strength proportional to [Formula: see text]. The model is shown to be consistent with experimental data from Caenorhabditis elegans connectivity and in vivo synaptic strength measurements. The [Formula: see text] dependence helps account for the observation of many zero or weak connections between neurons or sparsity of the neural network.Keywords
This publication has 29 references indexed in Scilit:
- Is cortical connectivity optimized for storing information?Nature Neuroscience, 2016
- Functional organization of excitatory synaptic strength in primary visual cortexNature, 2015
- Dendritic Integration in Hippocampal Dentate Granule CellsNeuron, 2011
- The Excitatory Neuronal Network of the C2 Barrel Column in Mouse Primary Somatosensory CortexNeuron, 2009
- What can we learn from synaptic weight distributions?Trends in Neurosciences, 2007
- Optimal Information Storage in Noisy Synapses under Resource ConstraintsNeuron, 2006
- Excitatory cortical neurons form fine-scale functional networksNature, 2005
- Optimal Information Storage and the Distribution of Synaptic WeightsNeuron, 2004
- Computational subunits in thin dendrites of pyramidal cellsNature Neuroscience, 2004
- Memory capacity in neural network models: Rigorous lower boundsNeural Networks, 2003