John Hertz
Research Subjects
John Hertz has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Barry J. Richmond
National Institute of Mental Health, National Institutes of Health
4 shared publications - Axel Svane
Department of Physics and Astronomy Aarhus University DK 8000 Aarhus C Denmark
2 shared publications - Hans C. Fogedby
Department of Physics and Astronomy University of Aarhus 8000 Ny Munkegade Aarhus C Denmark
2 shared publications - Kristian Nilsen
Nordita, Blegdamsvej 17, 2100 Copenhagen, Denmark
2 shared publications - Zhaoping Li
Gatsby Computational Neuroscience Unit UCL 17 Queen Square WC1N, 3AR London U.K
2 shared publications Adam Prügel-Bennett
NORDITA, Blegdamsvej 17, DK-2100 Copenhagen Ø, Denmark
1 shared publication
Latest Publications
- Open Access
Network Inference with Hidden Units
We derive learning rules for finding the connections between units in stochastic dynamical networks from the recorded history of a ``visible'' subset of the units. We consider two models. In both of them, the visible units are binary and stochastic. In one model the ``hidden'' units are continuous-valued, with sigmoidal activation functions, and in the other they are binary and stochastic like the visible ones. We derive exact learning rules for both cases. For the stochastic case, performing the exact calculation requires, in general, repeated summations over an number of configurations that grows exponentially with the size of the system and the data length, which is not feasible for large systems. We derive a mean field theory, based on a factorized ansatz for the distribution of hidden-unit states, which offers an attractive alternative for large systems. We present the results of some numerical calculations that illustrate key features of the two models and, for the stochastic case, the exact and approximate calculations.
Open AccessNetwork Inference with Hidden Units
We derive learning rules for finding the connections between units in stochastic dynamical networks from the recorded history of a ``visible'' subset of the units. We consider two models. In both of them, the visible units are binary and stochastic. In one model the ``hidden'' units are continuous-valued, with sigmoidal activation functions, and in the other they are binary and stochastic like the visible ones. We derive exact learning rules for both cases. For the stochastic case, performing the exact calculation requires, in general, repeated summations over an number of configurations that grows exponentially with the size of the system and the data length, which is not feasible for large systems. We derive a mean field theory, based on a factorized ansatz for the distribution of hidden-unit states, which offers an attractive alternative for large systems. We present the results of some numerical calculations that illustrate key features of the two models and, for the stochastic case, the exact and approximate calculations.
- 14 September 2004
- Published by American Physical Society (APS) in Physical Review E
- Vol. 70 (3) , 031105
Domain wall propagation and nucleation in a metastable two-level system
We present a dynamical description and analysis of nonequilibrium transitions in the noisy one-dimensional Ginzburg-Landau equation for an extensive system based on a weak noise canonical phase space formulation of the Freidlin-Wentzel or Martin-Siggia-Rose methods. We derive propagating nonlinear domain wall or soliton solutions of the resulting canonical field equations with superimposed diffusive modes. The transition pathways are characterized by the nucleation and subsequent propagation of domain walls. We discuss the general switching scenario in terms of a dilute gas of propagating domain walls and evaluate the Arrhenius factor in terms of the associated action. We find excellent agreement with recent numerical optimization studies.
- 14 September 2004
- Published by American Physical Society (APS) in Physical Review E
- Vol. 70 (3) , 031105
Domain wall propagation and nucleation in a metastable two-level system
We present a dynamical description and analysis of nonequilibrium transitions in the noisy one-dimensional Ginzburg-Landau equation for an extensive system based on a weak noise canonical phase space formulation of the Freidlin-Wentzel or Martin-Siggia-Rose methods. We derive propagating nonlinear domain wall or soliton solutions of the resulting canonical field equations with superimposed diffusive modes. The transition pathways are characterized by the nucleation and subsequent propagation of domain walls. We discuss the general switching scenario in terms of a dilute gas of propagating domain walls and evaluate the Arrhenius factor in terms of the associated action. We find excellent agreement with recent numerical optimization studies.
- 1 June 2004
- Published by Elsevier in Neurocomputing
- Vol. 58-60, 935-940
High-conductance states in a mean-field cortical network model
- 1 June 2004
- Published by Elsevier in Neurocomputing
- Vol. 58-60, 935-940
High-conductance states in a mean-field cortical network model
- 30 June 2003
- Published by Elsevier in Neurocomputing
- Vol. 52-54, 787-792
Anomalous response variability in a balanced cortical network model
- 30 June 2003
- Published by Elsevier in Neurocomputing
- Vol. 52-54, 787-792
Anomalous response variability in a balanced cortical network model
- Open Access
Soliton-dynamical approach to a noisy Ginzburg-Landau model
We present a dynamical description and analysis of non-equilibrium transitions in the noisy Ginzburg-Landau equation based on a canonical phase space formulation. The transition pathways are characterized by nucleation and subsequent propagation of domain walls or solitons. We also evaluate the Arrhenius factor in terms of an associated action and find good agreement with recent numerical optimization studies.
Open AccessSoliton-dynamical approach to a noisy Ginzburg-Landau model
We present a dynamical description and analysis of non-equilibrium transitions in the noisy Ginzburg-Landau equation based on a canonical phase space formulation. The transition pathways are characterized by nucleation and subsequent propagation of domain walls or solitons. We also evaluate the Arrhenius factor in terms of an associated action and find good agreement with recent numerical optimization studies.
- Open Access
Anomalous Response Variability in a Balanced Cortical Network Model
We use mean field theory to study the response properties of a simple randomly-connected model cortical network of leaky integrate-and-fire neurons with balanced excitation and inhibition. The formulation permits arbitrary temporal variation of the input to the network and takes exact account of temporal firing correlations. We find that neuronal firing statistics depend sensitively on the firing threshold. In particular, spike count variances can be either significantly greater than or significantly less than those for a Poisson process. These findings may help in understanding the variability observed experimentally in cortical neuronal responses.
Open AccessAnomalous Response Variability in a Balanced Cortical Network Model
We use mean field theory to study the response properties of a simple randomly-connected model cortical network of leaky integrate-and-fire neurons with balanced excitation and inhibition. The formulation permits arbitrary temporal variation of the input to the network and takes exact account of temporal firing correlations. We find that neuronal firing statistics depend sensitively on the firing threshold. In particular, spike count variances can be either significantly greater than or significantly less than those for a Poisson process. These findings may help in understanding the variability observed experimentally in cortical neuronal responses.
- 31 May 2001
- Published by Elsevier in Neurocomputing
- Vol. 38-40, 915-920
Stability of asynchronous firing states in networks with synaptic adaptation
- 31 May 2001
- Published by Elsevier in Neurocomputing
- Vol. 38-40, 915-920
Stability of asynchronous firing states in networks with synaptic adaptation
- Open Access
Odor recognition and segmentation by a model olfactory bulb and cortex
We present a model of an olfactory system that performs odor segmentation. Based on the anatomy and physiology of natural olfactory systems, it consists of a pair of coupled modules, bulb and cortex. The bulb encodes the odor inputs as oscillating patterns. The cortex functions as an associative memory: When the input from the bulb matches a pattern stored in the connections between its units, the cortical units resonate in an oscillatory pattern characteristic of that odor. Further circuitry transforms this oscillatory signal to a slowly-varying feedback to the bulb. This feedback implements olfactory segmentation by suppressing the bulbar response to the pre-existing odor, thereby allowing subsequent odors to be singled out for recognition.
Open AccessOdor recognition and segmentation by a model olfactory bulb and cortex
We present a model of an olfactory system that performs odor segmentation. Based on the anatomy and physiology of natural olfactory systems, it consists of a pair of coupled modules, bulb and cortex. The bulb encodes the odor inputs as oscillating patterns. The cortex functions as an associative memory: When the input from the bulb matches a pattern stored in the connections between its units, the cortical units resonate in an oscillatory pattern characteristic of that odor. Further circuitry transforms this oscillatory signal to a slowly-varying feedback to the bulb. This feedback implements olfactory segmentation by suppressing the bulbar response to the pre-existing odor, thereby allowing subsequent odors to be singled out for recognition.
- 1 February 2000
- Vol. 11 (1) , 83-102
Odour recognition and segmentation by a model olfactory bulb and cortex
We present a model of an olfactory system that performs odour segmentation. Based on the anatomy and physiology of natural olfactory systems, it consists of a pair of coupled modules, bulb and cortex. The bulb encodes the odour inputs as oscillating patterns. The cortex functions as an associative memory: when the input from the bulb matches a pattern stored in the connections between its units, the cortical units resonate in an oscillatory pattern characteristic of that odour. Further circuitry transforms this oscillatory signal to a slowly varying feedback to the bulb. This feedback implements olfactory segmentation by suppressing the bulbar response to the pre-existing odour, thereby allowing subsequent odours to be singled out for recognition.
- 1 February 2000
- Vol. 11 (1) , 83-102
Odour recognition and segmentation by a model olfactory bulb and cortex
We present a model of an olfactory system that performs odour segmentation. Based on the anatomy and physiology of natural olfactory systems, it consists of a pair of coupled modules, bulb and cortex. The bulb encodes the odour inputs as oscillating patterns. The cortex functions as an associative memory: when the input from the bulb matches a pattern stored in the connections between its units, the cortical units resonate in an oscillatory pattern characteristic of that odour. Further circuitry transforms this oscillatory signal to a slowly varying feedback to the bulb. This feedback implements olfactory segmentation by suppressing the bulbar response to the pre-existing odour, thereby allowing subsequent odours to be singled out for recognition.
- 30 June 1999
- Published by Elsevier in Neurocomputing
- Vol. 26-27, 247-254
The relation between V1 neuronal responses and eye movement-like stimulus presentations
- 30 June 1999
- Published by Elsevier in Neurocomputing
- Vol. 26-27, 247-254
The relation between V1 neuronal responses and eye movement-like stimulus presentations