The role of audiovisual congruence in aesthetic appreciation of contemporary music and visual art
Authors:
Open Access
- 9 September 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-9
Abstract
Does congruence between auditory and visual modalities affect aesthetic experience? While cross-modal correspondences between vision and hearing are well-documented, previous studies show conflicting results regarding whether audiovisual correspondence affects subjective aesthetic experience. Here, in collaboration with the Kentler International Drawing Space (NYC, USA), we depart from previous research by using music specifically composed to pair with visual art in the professionally-curated Music as Image and Metaphor exhibition. Our pre-registered online experiment consisted of 4 conditions: Audio, Visual, Audio-Visual-Intended (artist-intended pairing of art/music), and Audio-Visual-Random (random shuffling). Participants (N = 201) were presented with 16 pieces and could click to proceed to the next piece whenever they liked. We used time spent as an implicit index of aesthetic interest. Additionally, after each piece, participants were asked about their subjective experience (e.g., feeling moved). We found that participants spent significantly more time with Audio, followed by Audiovisual, followed by Visual pieces; however, they felt most moved in the Audiovisual (bi-modal) conditions. Ratings of audiovisual correspondence were significantly higher for the Audiovisual-Intended compared to Audiovisual-Random condition; interestingly, though, there were no significant differences between intended and random conditions on any other subjective rating scale, or for time spent. Collectively, these results call into question the relationship between cross-modal correspondence and aesthetic appreciation. Additionally, the results complicate the use of time spent as an implicit measure of aesthetic experience.Keywords
All Related Versions
Funding Information
- Max Planck Institute for Empirical Aesthetics
This publication has 30 references indexed in Scilit:
- Resolving the bouba-kiki effect enigma by rooting iconic sound symbolism in physical properties of round and spiky objectsScientific Reports, 2022
- Cross-modal associations between paintings and sounds: Effects of embodimentPerception, 2022
- An objective evaluation of the beholder’s response to abstract and figurative art based on construal level theoryProceedings of the National Academy of Sciences, 2020
- Assessing the Role of Emotional Mediation in Explaining Crossmodal Correspondences Involving Musical StimuliMultisensory Research, 2020
- The Perceptual and Aesthetic Aspects of the Music-Paintings CongruenceVision, 2019
- Sound symbolism scaffolds language development in preverbal infantsCortex, 2015
- Art in Time and Space: Context Modulates the Relation between Art Experience and Viewing TimePLOS ONE, 2014
- Audiovisual correspondence between musical timbre and visual shapesFrontiers in Human Neuroscience, 2014
- Sound symbolism in infancy: Evidence for sound–shape cross-modal correspondences in 4-month-oldsJournal of Experimental Child Psychology, 2013
- Crossmodal correspondences: A tutorial reviewAttention, Perception, & Psychophysics, 2011