Exploring the Semantic-Inconsistency Effect in Scenes Using a Continuous Measure of Linguistic-Semantic Similarity
- 23 April 2024
- journal article
- research article
- Published by SAGE Publications in Psychological Science
- Vol. 35 (6) , 623-634
Abstract
Viewers use contextual information to visually explore complex scenes. Object recognition is facilitated by exploiting object–scene relations (which objects are expected in a given scene) and object–object relations (which objects are expected because of the occurrence of other objects). Semantically inconsistent objects deviate from these expectations, so they tend to capture viewers’ attention (the semantic-inconsistency effect). Some objects fit the identity of a scene more or less than others, yet semantic inconsistencies have hitherto been operationalized as binary (consistent vs. inconsistent). In an eye-tracking experiment ( N = 21 adults), we study the semantic-inconsistency effect in a continuous manner by using the linguistic-semantic similarity of an object to the scene category and to other objects in the scene. We found that both highly consistent and highly inconsistent objects are viewed more than other objects (U-shaped relationship), revealing that the (in)consistency effect is more than a simple binary classification.Keywords
Funding Information
- Vlaamse regering (METH/21/02)
This publication has 31 references indexed in Scilit:
- The meaning and structure of scenesVision Research, 2021
- Reading scenes: how scene grammar guides attention and aids perception in real-world environmentsCurrent Opinion in Psychology, 2019
- The role of meaning in attentional guidance during free viewing of real-world scenesActa Psychologica, 2019
- Gaze Control as PredictionTrends in Cognitive Sciences, 2017
- Structures, Not Strings: Linguistics as Part of the Cognitive SciencesTrends in Cognitive Sciences, 2015
- Deriving semantic structure from category fluency: Clustering techniques and their pitfallsCortex, 2014
- Looking, language, and memory: Bridging research from the visual world and visual search paradigmsActa Psychologica, 2011
- Semantic guidance of eye movements in real-world scenesVision Research, 2011
- Chapter 2 Building the gist of a scene: the role of global image features in recognition2006
- Scene perception: Detecting and judging objects undergoing relational violationsCognitive Psychology, 1982