The DeepTune framework for modeling and characterizing neurons in visual cortex area V4
Preprint
Abstract
Deep neural network models have recently been shown to be effective in predicting single neuron responses in primate visual cortex areas V4. Despite their high predictive accuracy, these models are generally difficult to interpret. This limits their applicability in characterizing V4 neuron function. Here, we propose the DeepTune framework as a way to elicit interpretations of deep neural network-based models of single neurons in area V4. V4 is a midtier visual cortical area in the ventral visual pathway. Its functional role is not yet well understood. Using a dataset of recordings of 71 V4 neurons stimulated with thousands of static natural images, we build an ensemble of 18 neural network-based models per neuron that accurately predict its response given a stimulus image. To interpret and visualize these models, we use a stability criterion to form optimal stimuli (DeepTune images) by pooling the 18 models together. These DeepTune images not only confirm previous findings on the presence of diverse shape and texture tuning in area V4, but also provide rich, concrete and naturalistic characterization of receptive fields of individual V4 neurons. The population analysis of DeepTune images for 71 neurons reveals how different types of curvature tuning are distributed in V4. In addition, it also suggests strong suppressive tuning for nearly half of the V4 neurons. Though we focus exclusively on the area V4, the DeepTune framework could be applied more generally to enhance the understanding of other visual cortex areas.Keywords
This publication has 43 references indexed in Scilit:
- Sparse coding in striate and extrastriate visual cortexJournal of Neurophysiology, 2011
- A Sparse Object Coding Scheme in Area V4Current Biology, 2011
- Neural Representation of Natural Images in Visual Area V2Journal of Neuroscience, 2010
- Bayesian Reconstruction of Natural Images from Human Brain ActivityNeuron, 2009
- COMPLETE FUNCTIONAL CHARACTERIZATION OF SENSORY NEURONS BY SYSTEM IDENTIFICATIONAnnual Review of Neuroscience, 2006
- Do We Know What the Early Visual System Does?The Journal of Neuroscience, 2005
- Population coding of shape in area V4Nature Neuroscience, 2002
- Natural Image Statistics and Neural RepresentationAnnual Review of Neuroscience, 2001
- Selectivity for Polar, Hyperbolic, and Cartesian Gratings in Macaque Visual CortexScience, 1993
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970