Response dynamics in macaque ventral stream recapitulate the visual hierarchy
Preprint
Abstract
Chronic recording in macaque inferotemporal cortex (IT) revealed a progression of feature selectivity over the duration of the response, with different images evoking strongest responses in different time bins. Neurons responded briskly and transiently to early best images and gave slower and more sustained responses to later best images. Correlations between IT selectivity and deep neural network (DNN) activations in early layers were faster and more transient than correlations with deeper DNN layers, suggesting a hierarchical representation unfolding. Analysis of best images in different time bins showed that early best images were simpler, or made up of fewer parts, than later best images. This simple-to-complex selectivity dynamic is consistent with, but more universal than, previously reported dynamics of global-to-local or category-to-exemplar selectivity. In parallel with the simple-to-complex selectivity progression, the image selectivity and the population activity became sparser during the response, consistent with the hypothesis of a canonical cortical microcircuit that pools inputs and incorporates neighboring-neuron inhibition. We propose that this temporal cascade in IT recapitulates the multiple antecedent stages in the visual hierarchy, which also show a simple-to-complex progression of feature selectivity.Keywords
This publication has 49 references indexed in Scilit:
- A unifying framework for functional organization in early and higher ventral visual cortexNeuron, 2024
- The Function and Evolution of Motile DNA Replication Systems in CiliatesCurrent Biology, 2021
- Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A reviewInternational Journal of Automation and Computing, 2017
- A Real-World Size Organization of Object Responses in Occipitotemporal CortexNeuron, 2012
- Inhibitory Stabilization of the Cortical Network Underlies Visual Surround SuppressionNeuron, 2009
- Dynamic Shape Synthesis in Posterior Inferotemporal CortexNeuron, 2006
- Chronic multiunit recordings in behaving animals: advantages and limitations2005
- End-Stopping and the Aperture ProblemNeuron, 2003
- Hierarchical models of object recognition in cortexNature Neuroscience, 1999
- Averaged multiple unit activity as an estimate of phasic changes in local neuronal activity: effects of volume-conducted potentialsJournal of Neuroscience Methods, 1980