Cross-modal associations between paintings and sounds: Effects of embodiment
Authors:
Open Access
- 11 October 2022
- journal article
- research article
- Published by SAGE Publications in Perception
- Vol. 51 (12) , 871-888
Abstract
The present study investigated cross-modal associations between a series of paintings and sounds. We studied the effects of sound congruency (congruent vs. non-congruent sounds) and embodiment (embodied vs. synthetic sounds) on the evaluation of abstract and figurative paintings. Participants evaluated figurative and abstract paintings paired with congruent and non-congruent embodied and synthetic sounds. They also evaluated the perceived meaningfulness of the paintings, aesthetic value and immersive experience of the paintings. Embodied sounds (sounds associated with bodily sensations, bodily movements and touch) were more strongly associated with figurative paintings, while synthetic sounds (non-embodied sounds) were more strongly associated with abstract paintings. Sound congruency increased the perceived meaningfulness, immersive experience and aesthetic value of paintings. Sound embodiment increased immersive experience of paintings.Keywords
Funding Information
- Templeton Religion Trust (TRT0354)
This publication has 79 references indexed in Scilit:
- Music–color associations are mediated by emotionProceedings of the National Academy of Sciences, 2013
- Abstract art and cortical motor activation: an EEG studyFrontiers in Human Neuroscience, 2012
- Hearing Mouth Shapes: Sound Symbolism and the Reverse McGurk EffectI-Perception, 2012
- Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humansProceedings of the National Academy of Sciences, 2011
- Crossmodal correspondences: A tutorial reviewAttention, Perception, & Psychophysics, 2011
- The Mechanics of Embodiment: A Dialog on Embodiment and Computational ModelingFrontiers in Psychology, 2011
- The Perceptual Nature of the Cross-Modal Priming EffectExperimental Psychology, 2010
- Construal-level theory of psychological distance.Psychological Review, 2010
- On cross-modal similarity: Auditory–visual interactions in speeded discrimination.Journal of Experimental Psychology: Human Perception and Performance, 1987
- A study in phonetic symbolism.Journal of Experimental Psychology, 1929