Diffusion-based stimulus optimization reveals functional organization across higher visual cortex
Preprint
Abstract
Characterizing the fine-grained functional organization of human higher visual cortex remains a central challenge, as traditional neuroimaging experiments constrain the diversity of stimuli that can be sampled. In prior work we addressed this challenge by developing a novel data-driven tool, termed “BrainDiVE” (Luo et al. 2023), which synthesizes naturalistic images predicted to strongly activate specific brain regions. BrainDiVE leverages pretrained image diffusion models guided by gradients from an image-computable fMRI encoding model. Here, we experimentally validated BrainDiVE by generating images predicted to maximally activate different functional regions of interest and then presenting them to new participants (n=12) in an fMRI study. The model-generated images elicited robust, spatially specific responses in the targeted brain regions, producing significantly greater category selectivity than natural images, validating the method’s ability to capture generalizable neural tuning properties in human ventral visual cortex. We further showed that region-targeted images exaggerate specific sets of low-level and mid-level image statistics, suggesting that category-selective regions are tuned to continuous directions in feature space. Moreover, we demonstrated fine-grained experimental control by differentially activating two face-selective regions, the occipital face area (OFA) and fusiform face area (FFA), providing additional evidence that these regions encode distinct aspects of faces. Finally, we identify a posterior-to-anterior functional gradient within the occipital place area (OPA), suggesting topographic organization based on scene properties such as distance and indoor-outdoor location. These findings enhance our understanding of the representational structure of category-selective regions and introduce a new paradigm for probing neural selectivity in human visual cortex.Keywords
This publication has 57 references indexed in Scilit:
- Color-biased regions in the ventral visual pathway are food selectiveCurrent Biology, 2022
- Visual cortex: Big data analysis uncovers food specificityCurrent Biology, 2022
- A highly selective response to food in human visual cortex revealed by hypothesis-free voxel decompositionCurrent Biology, 2022
- Evolving Images for Visual Neurons Using a Deep Generative Network Reveals Coding Principles and Neuronal PreferencesCell, 2019
- Microsoft COCO: Common Objects in Context2014
- The role of the occipital face area in the cortical face perception networkExperimental Brain Research, 2011
- Accurate and robust brain image alignment using boundary-based registrationNeuroImage, 2009
- Fast robust automated brain extractionHuman Brain Mapping, 2002
- Temporal Autocorrelation in Univariate Linear Modeling of FMRI DataNeuroImage, 2001
- Cortical Surface-Based AnalysisNeuroImage, 1999