Estimating linear–nonlinear models using Rényi divergences
- 1 January 2009
- journal article
- Published by Taylor & Francis in Network: Computation in Neural Systems
- Vol. 20 (2) , 49-68
Abstract
This article compares a family of methods for characterizing neural feature selectivity using natural stimuli in the framework of the linear-nonlinear model. In this model, the spike probability depends in a nonlinear way on a small number of stimulus dimensions. The relevant stimulus dimensions can be found by optimizing a Rényi divergence that quantifies a change in the stimulus distribution associated with the arrival of single spikes. Generally, good reconstructions can be obtained based on optimization of Rényi divergence of any order, even in the limit of small numbers of spikes. However, the smallest error is obtained when the Rényi divergence of order 1 is optimized. This type of optimization is equivalent to information maximization, and is shown to saturate the Cramer-Rao bound describing the smallest error allowed for any unbiased method. We also discuss conditions under which information maximization provides a convenient way to perform maximum likelihood estimation of linear-nonlinear models from neural data.Keywords
This publication has 35 references indexed in Scilit:
- Spatio-temporal correlations and visual signalling in a complete neuronal populationNature, 2008
- Comparison of information and variance maximization strategies for characterizing neural feature selectivityStatistics in Medicine, 2007
- Precise physical models of protein–DNA interaction from high-throughput dataProceedings of the National Academy of Sciences, 2007
- Effects of stimulus transformations on estimates of sensory neuron selectivityJournal of Computational Neuroscience, 2006
- Estimating receptive fields in the presence of spike-time jitterNetwork: Computation in Neural Systems, 2006
- Dejittered Spike-Conditioned Stimulus Waveforms Yield Improved Estimates of Neuronal Feature Selectivity and Spike-Timing Precision of Sensory InterneuronsJournal of Neuroscience, 2005
- Analysis of neural coding through quantization with an information-based distortion measureNetwork: Computation in Neural Systems, 2003
- Receptive field structure of neurons in monkey primary visual cortex revealed by stimulation with natural image sequencesJournal of Vision, 2002
- Synergy in a Neural CodeNeural Computation, 2000
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995