Deep Convolutional modeling of human face selective columns reveals their role in pictorial face representation
Authors:
- Shany GrossmanSGShany Grossman
- Guy GazivGGGuy Gaziv
- Erin M YeagleEYErin M Yeagle
- Michal HarelMHMichal Harel
- Pierre MégevandPMPierre Mégevand
- David M GroppeDGDavid M Groppe
- Simon KhuvisSKSimon Khuvis
- Jose L HerreroJHJose L Herrero
- Michal IraniMIMichal Irani
- Ashesh D MehtaAMAshesh D Mehta
- Rafael MalachRMRafael Malach
Preprint
Abstract
Despite the massive accumulation of systems neuroscience findings, their functional meaning remains tentative, largely due to the absence of realistically performing models. The discovery that deep convolutional networks achieve human performance in realistic tasks offers fresh opportunities for such modeling. Here we show that the face-space topography of face-selective columns recorded intra-cranially in 32 patients significantly matches that of a DCNN having human-level face recognition capabilities. Three modeling aspects converge in pointing to a role of human face areas in pictorial rather than person identification: First, the match was confined to intermediate layers of the DCNN. Second, identity preserving image manipulations abolished the brain to DCNN correlation. Third, DCNN neurons matching face-column tuning displayed view-point selective receptive fields. Our results point to a “convergent evolution” of pattern similarities in biological and artificial face perception. They demonstrate DCNNs as a powerful modeling approach for deciphering the function of human cortical networks.Keywords
This publication has 53 references indexed in Scilit:
- Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing SystemScience, 2010
- Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclatureNeuroImage, 2010
- Neural “Ignition”: Enhanced Activation Linked to Perceptual Awareness in Human Ventral Stream Visual CortexNeuron, 2009
- Broadband Shifts in Local Field Potential Power Spectra Are Correlated with Single-Neuron Spiking in HumansThe Journal of Neuroscience, 2009
- Functional MRI Reveals Compromised Neural Integrity of the Face Processing Network in Congenital ProsopagnosiaCurrent Biology, 2009
- Matching Categorical Object Representations in Inferior Temporal Cortex of Man and MonkeyNeuron, 2008
- Neural Correlates of High-Gamma Oscillations (60–200 Hz) in Macaque Local Field Potentials and Their Potential Implications in ElectrocorticographyThe Journal of Neuroscience, 2008
- Coupling between Neuronal Firing Rate, Gamma LFP, and BOLD fMRI Is Related to Interneuronal CorrelationsCurrent Biology, 2007
- Enhanced Category Tuning Revealed by Intracranial Electroencephalograms in High-Order Human Visual AreasJournal of Neuroscience, 2007
- Cortical Surface-Based AnalysisNeuroImage, 1999