Neuronal tuning aligns dynamically with object and texture manifolds across the visual hierarchy
Open Access
- 10 March 2026
- journal article
- Published by Springer Nature in Nature Neuroscience
- Vol. 29 (4) , 864-875
Abstract
Visual neurons respond to a vast range of images, from textures to objects, but the rules linking these responses remain unclear. Although tuning to simple features is well established in the primary visual cortex, this framework breaks down in higher areas, where neurons encode diverse and unpredictable features. To ask what features neurons prioritize, we used generative models (deep networks that synthesize new images from a learned latent space), allowing neurons in V1, V4 and the posterior inferotemporal cortex (PIT) to guide image synthesis through closed-loop optimization. We compared models that emphasize texture versus those that emphasize object structure. Although V1 and V4 aligned more strongly with texture-based spaces, many PIT neurons responded equally well to both types of optimized images, revealing a focus on shared local motifs rather than whole-object templates, and this alignment to objects emerged later in their response. These findings reveal coding principles across the ventral stream and clarify the limits of current vision models.Keywords
Funding Information
- National Eye Institute (DP2EY035176-01)
- National Eye Institute (P30EY012196-26)
- National Science Foundation (CAREER 2143077)
- David and Lucile Packard Foundation (2020-71377)
This publication has 54 references indexed in Scilit:
- Spurious reconstruction from brain activityNeural Networks, 2025
- Tuning landscapes of the ventral streamCell Reports, 2022
- Integrative Benchmarking to Advance Neurally Mechanistic Models of Human IntelligenceNeuron, 2020
- NIMH MonkeyLogic: Behavioral control and data acquisition in MATLABJournal of Neuroscience Methods, 2019
- Evolving Images for Visual Neurons Using a Deep Generative Network Reveals Coding Principles and Neuronal PreferencesCell, 2019
- The Code for Facial Identity in the Primate BrainCell, 2017
- A Channel for 3D Environmental Shape in Anterior Inferotemporal CortexNeuron, 2014
- Perceptual wholes can reduce the conscious accessibility of their partsCognition, 2012
- Dynamic Shape Synthesis in Posterior Inferotemporal CortexNeuron, 2006
- The orientation and direction selectivity of cells in macaque visual cortexVision Research, 1982