Spatiotemporal representations of contextual associations for real-world objects
Authors:
- Lu-Chun YehLYLu-Chun Yeh
- Marius V. PeelenMPMarius V. Peelen
- Daniel KaiserDKDaniel Kaiser
Preprint
Abstract
In the real world, objects always appear in context. Many objects are reliably associated with a certain scene context (e.g., pots appear in kitchens) and other objects that appear in the same context (e.g., pans appear together with pots). Previous neuroimaging work suggests that such contextual associations shape the neural representation of isolated objects even in the absence of the scene context. Yet, three key questions remain unanswered: (1) How do representations of contextual associations relate to perceptual and categorical representation in visual cortex, (2) how do they emerge across time, and (3) how are they mechanistically implemented? To answer these questions, we recorded fMRI and EEG while participants (human, both sexes) viewed isolated objects stemming from two scene contexts. Multivariate pattern analysis on the neural data revealed that objects from the same context were coded more similarly than objects from different contexts in object-selective LOC and scene-selective PPA, even when systematically controlling for perceptual and categorical similarities. Such contextual relation representations emerged relatively late during visual processing (i.e., after perceptual and categorical representations), specifically in the anterior PPA, and likely through a mixture of object-to-object and object-to-scene associations. Together, our results demonstrate that contextual relation representations emerged for isolated objects, and without a task that encourages their formation, suggesting that objects automatically activate context frames that support visual cognition in real-world environments.Keywords
All Related Versions
- Published version: The Journal of Neuroscience, 46 (19).
Funding Information
- HORIZON EUROPE Marie Sklodowska-Curie Actions (101149060)
- Deutsche Forschungsgemeinschaft (SFB/TRR135, project number 222641018)
- Deutsche Forschungsgemeinschaft (KA4683/5-1, project number 518483074)
- Deutsche Forschungsgemeinschaft (KA4683/6-1, project number 536053998)
- Deutsche Forschungsgemeinschaft (Germany’s Excellence Strategy (EXC 3066/1 “The Adaptive Mind”, project number 533717223))
- ERC starting Grant (PEP, ERC-2022-STG 101076057)
This publication has 52 references indexed in Scilit:
- The timecourse of inter-object contextual facilitationCortex, 2025
- MEG sensor patterns reflect perceptual but not categorical similarity of animate and inanimate objectsNeuroImage, 2019
- Human Scene-Selective Areas Represent 3D Configurations of SurfacesNeuron, 2019
- Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networksNeuroImage, 2016
- Differential connectivity within the Parahippocampal Place AreaNeuroImage, 2013
- Exploring the role of space-defining objects in constructing and maintaining imagined scenesBrain and Cognition, 2013
- An algorithmic method for functionally defining regions of interest in the ventral visual pathwayNeuroImage, 2012
- Nonparametric statistical testing of EEG- and MEG-dataJournal of Neuroscience Methods, 2007
- The effect of scene context on episodic object recognition: Parahippocampal cortex mediates memory encoding and retrieval successHippocampus, 2007
- Image Distortion Correction in fMRI: A Quantitative EvaluationNeuroImage, 2002