Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
Open Access
- 1 July 2023
- journal article
- research article
- Published by SAGE Publications in I-Perception
- Vol. 14 (4)
Abstract
People occasionally associate color (e.g., hue) with sound (e.g., pitch). Previous studies have reported color–sound associations, which are examples of crossmodal correspondences. However, the association between both semantic and perceptual factors with color/sound discrimination in crossmodal correspondence remains unclear. To clarify this, three psychological experiments were conducted, where Stroop tasks were used to assess automatic process on the association. We focused on the crossmodal correspondence between color (Experiment 1)/color word (Experiment 2) and sound. Participants discriminated the color/word or the sound presented simultaneously. The results showed the color–sound bidirectional enhancement/interference of the response by certain associations of the crossmodal correspondence (blue-drop and yellow-shiny) in both experiments. These results suggest that these Stroop effects were caused by the semantic factor (color category) and the perceptual factor (color appearance) was not necessary for the current results. In Experiment 3, response modulation by color labeling was investigated to clarify the influence of subjective labeling. Participants labeled a presented ambiguous color, which was a hue specification between two specific colors, by listening to the sound. The results revealed that the Stroop effect was caused only when the presented color was classified as the color related to the presented sound. This showed that subjective labeling played a role in the regulation of the effect of crossmodal correspondences. These findings should contribute to the explanation of crossmodal correspondences through semantic mediation.Keywords
Funding Information
- Japan Society for the Promotion of Science (JP19H01119, JP20H05956, JP22K12218)
This publication has 57 references indexed in Scilit:
- Music–color associations are mediated by emotionProceedings of the National Academy of Sciences, 2013
- Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humansProceedings of the National Academy of Sciences, 2011
- Crossmodal correspondences: A tutorial reviewAttention, Perception, & Psychophysics, 2011
- The Perceptual Nature of the Cross-Modal Priming EffectExperimental Psychology, 2010
- Statistical power analyses using G*Power 3.1: Tests for correlation and regression analysesBehavior Research Methods, 2009
- The Stroop effect in kana and kanji scripts in native Japanese speakers: An fMRI studyBrain and Language, 2008
- Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual IllusionThe Journal of Neuroscience, 2007
- Measurement of Color Constancy by Color Memory MatchingOptical Review, 1998
- Processes underlying dimensional interactions: Correspondences between linguistic and nonlinguistic dimensionsMemory & Cognition, 1990
- On cross-modal similarity: Auditory–visual interactions in speeded discrimination.Journal of Experimental Psychology: Human Perception and Performance, 1987