An Efficient Coding Hypothesis Links Sparsity and Selectivity of Neural Responses
Open Access
- 13 October 2011
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 6 (10) , e25506
Abstract
To what extent are sensory responses in the brain compatible with first-order principles? The efficient coding hypothesis projects that neurons use as few spikes as possible to faithfully represent natural stimuli. However, many sparsely firing neurons in higher brain areas seem to violate this hypothesis in that they respond more to familiar stimuli than to nonfamiliar stimuli. We reconcile this discrepancy by showing that efficient sensory responses give rise to stimulus selectivity that depends on the stimulus-independent firing threshold and the balance between excitatory and inhibitory inputs. We construct a cost function that enforces minimal firing rates in model neurons by linearly punishing suprathreshold synaptic currents. By contrast, subthreshold currents are punished quadratically, which allows us to optimally reconstruct sensory inputs from elicited responses. We train synaptic currents on many renditions of a particular bird's own song (BOS) and few renditions of conspecific birds' songs (CONs). During training, model neurons develop a response selectivity with complex dependence on the firing threshold. At low thresholds, they fire densely and prefer CON and the reverse BOS (REV) over BOS. However, at high thresholds or when hyperpolarized, they fire sparsely and prefer BOS over REV and over CON. Based on this selectivity reversal, our model suggests that preference for a highly familiar stimulus corresponds to a high-threshold or strong-inhibition regime of an efficient coding strategy. Our findings apply to songbird mirror neurons, and in general, they suggest that the brain may be endowed with simple mechanisms to rapidly change selectivity of neural responses to focus sensory processing on either familiar or nonfamiliar stimuli. In summary, we find support for the efficient coding hypothesis and provide new insights into the interplay between the sparsity and selectivity of neural responses.Keywords
This publication has 57 references indexed in Scilit:
- Role of the Zebra Finch Auditory Thalamus in Generating Complex Representations for Natural SoundsJournal of Neurophysiology, 2010
- Perceptron learning rule derived from spike-frequency adaptation and spike-time-dependent plasticityProceedings of the National Academy of Sciences, 2010
- Developmental experience alters information coding in auditory midbrain and forebrain neuronsDevelopmental Neurobiology, 2010
- A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errorsProceedings of the National Academy of Sciences, 2009
- Sparse coding of birdsong and receptive field structure in songbirdsNetwork: Computation in Neural Systems, 2009
- Organizing Principles of Spectro-Temporal Encoding in the Avian Primary Auditory Area Field LNeuron, 2008
- Sparse Representation of Sounds in the Unanesthetized Auditory CortexPLOS Biology, 2008
- Efficient auditory codingNature, 2006
- Olfactory network dynamics and the coding of multidimensional signalsNature Reviews Neuroscience, 2002
- Fast and robust fixed-point algorithms for independent component analysisIEEE Transactions on Neural Networks, 1999