Contextual associations represented both in neural networks and human behavior
Open Access
- 2 April 2022
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 12 (1) , 1-12
Abstract
Contextual associations facilitate object recognition in human vision. However, the role of context in artificial vision remains elusive as does the characteristics that humans use to define context. We investigated whether contextually related objects (bicycle-helmet) are represented more similarly in convolutional neural networks (CNNs) used for image understanding than unrelated objects (bicycle-fork). Stimuli were of objects against a white background and consisted of a diverse set of contexts (N = 73). CNN representations of contextually related objects were more similar to one another than to unrelated objects across all CNN layers. Critically, the similarity found in CNNs correlated with human behavior across multiple experiments assessing contextual relatedness, emerging significant only in the later layers. The results demonstrate that context is inherently represented in CNNs as a result of object recognition training, and that the representation in the later layers of the network tap into the contextual regularities that predict human behavior.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks2016
- Deep Residual Learning for Image Recognition2016
- Associative Processing Is Inherent in Scene PerceptionPLOS ONE, 2015
- Going deeper with convolutions2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- ERP evidence for context congruity effects during simultaneous object–scene processingNeuropsychologia, 2010
- Visual long-term memory has a massive storage capacity for object detailsProceedings of the National Academy of Sciences, 2008
- Scene Consistency in Object and Background PerceptionPsychological Science, 2004
- Scene perception: Detecting and judging objects undergoing relational violationsCognitive Psychology, 1982
- The effects of contextual scenes on the identification of objectsMemory & Cognition, 1975