Dynamic Finite Size Effects in Spiking Neural Networks
Open Access
- 24 January 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 9 (1) , e1002872
Abstract
We investigate the dynamics of a deterministic finite-sized network of synaptically coupled spiking neurons and present a formalism for computing the network statistics in a perturbative expansion. The small parameter for the expansion is the inverse number of neurons in the network. The network dynamics are fully characterized by a neuron population density that obeys a conservation law analogous to the Klimontovich equation in the kinetic theory of plasmas. The Klimontovich equation does not possess well-behaved solutions but can be recast in terms of a coupled system of well-behaved moment equations, known as a moment hierarchy. The moment hierarchy is impossible to solve but in the mean field limit of an infinite number of neurons, it reduces to a single well-behaved conservation law for the mean neuron density. For a large but finite system, the moment hierarchy can be truncated perturbatively with the inverse system size as a small parameter but the resulting set of reduced moment equations that are still very difficult to solve. However, the entire moment hierarchy can also be re-expressed in terms of a functional probability distribution of the neuron density. The moments can then be computed perturbatively using methods from statistical field theory. Here we derive the complete mean field theory and the lowest order second moment corrections for physiologically relevant quantities. Although we focus on finite-size corrections, our method can be used to compute perturbative expansions in any parameter. One avenue towards understanding how the brain functions is to create computational and mathematical models. However, a human brain has on the order of a hundred billion neurons with a quadrillion synaptic connections. Each neuron is a complex cell comprised of multiple compartments hosting a myriad of ions, proteins and other molecules. Even if computing power continues to increase exponentially, directly simulating all the processes in the brain on a computer is not feasible in the foreseeable future and even if this could be achieved, the resulting simulation may be no simpler to understand than the brain itself. Hence, the need for more tractable models. Historically, systems with many interacting bodies are easier to understand in the two opposite limits of a small number or an infinite number of elements and most of the theoretical efforts in understanding neural networks have been devoted to these two limits. There has been relatively little effort directed to the very relevant but difficult regime of large but finite networks. In this paper, we introduce a new formalism that borrows from the methods of many-body statistical physics to analyze finite size effects in spiking neural networks.Keywords
This publication has 58 references indexed in Scilit:
- Mean-field description and propagation of chaos in networks of Hodgkin-Huxley and FitzHugh-Nagumo neuronsThe Journal of Mathematical Neuroscience, 2012
- Systematic Fluctuation Expansion for Neural Network Activity EquationsNeural Computation, 2010
- Generating Coherent Patterns of Activity from Chaotic Neural NetworksNeuron, 2009
- A constructive mean-field analysis of multi population neural networks with random synaptic weights and stochastic inputsFrontiers in Computational Neuroscience, 2009
- Type I Membranes, Phase Resetting Curves, and SynchronyNeural Computation, 1996
- Reliability of Spike Timing in Neocortical NeuronsScience, 1995
- Stability of incoherence in a population of coupled oscillatorsJournal of Statistical Physics, 1991
- Statistical mechanics of a nonlinear stochastic modelJournal of Statistical Physics, 1978
- Dynamics of pattern formation in lateral-inhibition type neural fieldsBiological Cybernetics, 1977
- A mathematical theory of the functional dynamics of cortical and thalamic nervous tissueBiological Cybernetics, 1973