CPCarlos R. Ponce

Carlos R. Ponce

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Carlos R. Ponce has a total of 36 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Trial-by-trial inter-areal interactions in visual cortex in the presence or absence of visual stimulation

    by Dianna Hidalgo, Giorgia Dellaferrera, Giordano Ramos-Traslosheros, Will Xiao, Carlos R Ponce, Maria Papadopouli, Stelios Smirnakis, Gabriel Kreiman

    State-of-the-art computational models of vision largely focus on fitting trial-averaged spike counts to visual stimuli using overparameterized neural networks. However, a computational model of the visual cortex should predict the dynamic responses of neurons in single trials across different experimental conditions. In this study, we investigated trial-by-trial inter-areal interactions in the visual cortex by predicting neuronal activity in one area based on activity in another, distinguishing between stimulus-driven and non-stimulus-driven shared variability. We analyzed two datasets: calcium imaging from mouse V1 layers 2/3 and 4, and extracellular neurophysiological recordings from macaque V1 and V4. Our results show that neuronal activity can be predicted bidirectionally between L2/3 and L4 in mice, and between V1 and V4 in macaque monkeys, with the latter interaction exhibiting directional asymmetry. The predictability of neuronal responses varied with the type of visual stimulus, yet responses could also be predicted in the absence of visual stimulation. In mice, we observed a bimodal distribution of neurons, with some neurons primarily driven by visual inputs and others showing predictable activity during spontaneous activity despite lacking consistent visually evoked responses. Predictability also depended on intrinsic neuronal properties, receptive field overlap, and the relative timing of activity across areas. Our findings highlight the presence of both stimulus- and non-stimulus-related components in interactions between visual areas across diverse contexts and underscore the importance of non-visual shared variability between visual regions in both mice and macaques.

  • Open Access

    Neuronal tuning aligns dynamically with object and texture manifolds across the visual hierarchy

    by Binxu Wang, Carlos R. Ponce

    Visual neurons respond to a vast range of images, from textures to objects, but the rules linking these responses remain unclear. Although tuning to simple features is well established in the primary visual cortex, this framework breaks down in higher areas, where neurons encode diverse and unpredictable features. To ask what features neurons prioritize, we used generative models (deep networks that synthesize new images from a learned latent space), allowing neurons in V1, V4 and the posterior inferotemporal cortex (PIT) to guide image synthesis through closed-loop optimization. We compared models that emphasize texture versus those that emphasize object structure. Although V1 and V4 aligned more strongly with texture-based spaces, many PIT neurons responded equally well to both types of optimized images, revealing a focus on shared local motifs rather than whole-object templates, and this alignment to objects emerged later in their response. These findings reveal coding principles across the ventral stream and clarify the limits of current vision models.


  • Open Access

    Brain feature maps reveal progressive animal-feature representations in the ventral stream

    by Zhanqi Zhang, Till S. Hartmann, Richard T. Born, Margaret S. Livingstone, Carlos R. Ponce

    What are the fundamental principles that inform representation in the primate visual brain? While objects have become an intuitive framework for studying neurons in many parts of cortex, it is possible that neurons follow a more expressive organizational principle, such as encoding generic features present across textures, places, and objects. In this study, we used multielectrode arrays to record from neurons in the early (V1/V2), middle (V4), and later [posterior inferotemporal (PIT) cortex] areas across the visual hierarchy, estimating each neuron’s local operation across natural scene via “heatmaps.” We found that, while populations of neurons with foveal receptive fields across V1/V2, V4, and PIT responded over the full scene, they focused on salient subregions within object outlines. Notably, neurons preferentially encoded animal features rather than general objects, with this trend strengthening along the visual hierarchy. These results show that the monkey ventral stream is partially organized to encode local animal features over objects, even as early as primary visual cortex.

  • Open Access

    Trial-by-trial inter-areal interactions in visual cortex in the presence or absence of visual stimulation

    by Dianna Hidalgo, Giorgia Dellaferrera, Giordano Ramos-Traslosheros, Will Xiao, Carlos R. Ponce, Maria Papadopouli, Stelios Smirnakis, Gabriel Kreiman

    State-of-the-art computational models of vision largely focus on fitting trial-averaged spike counts to visual stimuli using overparameterized neural networks. However, a computational model of the visual cortex should predict the dynamic responses of neurons in single trials across different experimental conditions. In this study, we investigated trial-by-trial inter-areal interactions in the visual cortex by predicting neuronal activity in one area based on activity in another, distinguishing between stimulus-driven and non-stimulus-driven shared variability. We analyzed two datasets: calcium imaging from mouse V1 layers 2/3 and 4, and extracellular neurophysiological recordings from macaque V1 and V4. Our results show that neuronal activity can be predicted bidirectionally between L2/3 and L4 in mice, and between V1 and V4 in macaque monkeys, with the latter interaction exhibiting directional asymmetry. The predictability of neuronal responses varied with the type of visual stimulus, yet responses could also be predicted in the absence of visual stimulation. In mice, we observed a bimodal distribution of neurons, with some neurons primarily driven by visual inputs and others showing predictable activity during spontaneous activity despite lacking consistent visually evoked responses. Predictability also depended on intrinsic neuronal properties, receptive field overlap, and the relative timing of activity across areas. Our findings highlight the presence of both stimulus- and non-stimulus-related components in interactions between visual areas across diverse contexts and underscore the importance of non-visual shared variability between visual regions in both mice and macaques.

  • Open Access

    Brain Feature Maps Reveal Progressive Animal-Feature Representations in the Ventral Stream

    by Zhanqi Zhang, Till S. Hartmann, Richard T. Born, Margaret S. Livingstone, Carlos R. Ponce

    What are the fundamental units of representation in the primate visual brain? Whileobjectshave become an intuitive framework for studying neurons in many parts of cortex, it is possible that neurons follow a more expressive organizational principle, such as encoding generic features present across textures, places, and objects. In this study, we used multi-electrode arrays to record from neurons in early (V1/V2), middle (V4), and late (posterior inferotemporal cortex (PIT)) areas across the visual hierarchy, estimating the local operation of each neuron over the entire visual scene. These estimates, called “heatmaps,” approximate theweight sharingoperation of convolutional neural networks. We found that while populations of neurons across V1, V4, and PIT responded over the full scene, they focused on salient sub-regions within object outlines. The best captured object feature class belonged toanimals, not general objects, as a trend that increased over the visual hierarchy. These results show that the monkey ventral stream is partially organized to encode local animal features over objects, even as early as primary visual cortex.

  • Open Access

    A concentration of visual cortex-like neurons in prefrontal cortex

    by Olivia Rose, Carlos R. Ponce

    Visual recognition is largely realized through neurons in the ventral stream, though recently, studies have suggested that ventrolateral prefrontal cortex (vlPFC) is also important for visual processing. While it is hypothesized that sensory and cognitive processes are integrated in vlPFC neurons, it is not clear how this mechanism benefits vision, or even if vlPFC neurons have properties essential for computations in visual cortex implemented via recurrence. Here, we investigated if vlPFC neurons in two male monkeys had functions comparable to visual cortex, including receptive fields, image selectivity, and the capacity to synthesize highly activating stimuli using generative networks. We found a subset of vlPFC sites show all properties, suggesting subpopulations of vlPFC neurons encode statistics about the world. Further, these vlPFC sites may be anatomically clustered, consistent with fMRI-identified functional organization. Our findings suggest that stable visual encoding in vlPFC may be a necessary condition for local and brain-wide computations.


  • Open Access

    Neural Dynamics of Object Manifold Alignment in the Ventral Stream

    by Binxu Wang, Carlos R. Ponce

    Visual neurons respond across a vast landscape of images, comprising objects, textures, and places. Natural images can be parameterized using deep generative networks, raising the question of whether latent factors learned by some networks control images in ways that better align with visual neurons. We studied neurons in areas V1, V4 and posterior IT, optimizing images using a closed-loop evolutionary algorithm. We used two generative image models: (1) DeePSim, which parameterizes local image patterns, and (2) BigGAN which parameterizes object identity and nuisance variables. We found that neurons could guide image optimization on both pattern- and object-based image manifolds across areas; V1 aligned best with the DeePSim image space, whereas PIT aligned well with both DeePSim and BigGAN spaces. While initially PIT neurons responded well to the textural manifold, their responses to objects also emerged over time, suggesting that object-like responses required further processing. We identified similar local features common to both textural and object images, but not optimal global configuration. We conclude that visual cortex neurons are aligned to a representational space not yet captured by current artificial model of the visual system.

  • Open Access

    Macaques recognize features in synthetic images derived from ventral stream neurons

    by Katherine N. Mueller, Mary C. Carter, Jeevun A. Kansupada, Carlos R. Ponce

    Primates can recognize features in virtually all types of images, an ability that still requires a comprehensive computational explanation. One hypothesis is that visual cortex neurons learn patterns from scenes, objects, and textures, and use these patterns to interpolate incoming visual information. We have used machine learning algorithms to instantiate visual patterns stored by neurons—we call these highly activating images prototypes. Prototypes from inferotemporal (IT) neurons often resemble parts of real-world objects, such as monkey faces and body parts, a similarity established via pretrained neural networks [C. R. Ponce et al ., Cell 177 , 999–1009.e10 (2019)] and naïve human participants [A. Bardon, W. Xiao, C. R. Ponce, M. S. Livingstone, G. Kreiman, Proc. Natl. Acad. Sci. U.S.A. 119 , e2118705119 (2022)]. However, it is not known whether monkeys themselves perceive similarities between neuronal prototypes and real-world objects. Here, we investigated whether monkeys reported similarities between prototypes and real-world objects using a two-alternative forced choice task. We trained the animals to saccade to synthetic images of monkeys, and subsequently tested how they classified prototypes synthesized from IT and primary visual cortex (V1). We found monkeys classified IT prototypes as conspecifics more often than they did random generator images and V1 prototypes, and their choices were partially predicted by convolutional neural networks. Further, we confirmed that monkeys could abstract general shape information from images of real-world objects. Finally, we verified these results with human participants. Our results provide further evidence that prototypes from cortical neurons represent interpretable abstractions from the visual world.


  • Open Access

    On the Level Sets and Invariance of Neural Tuning Landscapes

    by Binxu Wang, Carlos R. Ponce

    Visual representations can be defined as the activations of neuronal populations in response to images. The activation of a neuron as a function over all image space has been described as a "tuning landscape". As a function over a high-dimensional space, what is the structure of this landscape? In this study, we characterize tuning landscapes through the lens of level sets and Morse theory. A recent study measured the in vivo two-dimensional tuning maps of neurons in different brain regions. Here, we developed a statistically reliable signature for these maps based on the change of topology in level sets. We found this topological signature changed progressively throughout the cortical hierarchy, with similar trends found for units in convolutional neural networks (CNNs). Further, we analyzed the geometry of level sets on the tuning landscapes of CNN units. We advanced the hypothesis that higher-order units can be locally regarded as isotropic radial basis functions, but not globally. This shows the power of level sets as a conceptual tool to understand neuronal activations over image space.