The time course of emotion recognition in speech and music
Authors:
- 1 May 2019
- journal article
- conference paper
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 145 (5) , 3058-3074
Abstract
The auditory gating paradigm was adopted to study how much acoustic information is needed to recognize emotions from speech prosody and music performances. In Study 1, brief utterances conveying ten emotions were segmented into temporally fine-grained gates and presented to listeners, whereas Study 2 instead used musically expressed emotions. Emotion recognition accuracy increased with increasing gate duration and generally stabilized after a certain duration, with different trajectories for different emotions. Above-chance accuracy was observed for ≤100 ms stimuli for anger, happiness, neutral, and sadness, and for ≤250 ms stimuli for most other emotions, for both speech and music. This suggests that emotion recognition is a fast process that allows discrimination of several emotions based on low-level physical characteristics. The emotion identification points, which reflect the amount of information required for stable recognition, were shortest for anger and happiness for both speech and music, but recognition took longer to stabilize for music vs speech. This, in turn, suggests that acoustic cues that develop over time also play a role for emotion inferences (especially for music). Finally, acoustic cue patterns were positively correlated between speech and music, suggesting a shared acoustic code for expressing emotions.Keywords
Funding Information
- Vetenskapsrådet (2012-801)
This publication has 80 references indexed in Scilit:
- Feeling backwards? How temporal order in speech affects the time course of vocal emotion recognitionFrontiers in Psychology, 2013
- Cross-cultural decoding of positive and negative non-linguistic emotion vocalizationsFrontiers in Psychology, 2013
- On the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in CommonFrontiers in Psychology, 2013
- Reduced sensitivity to emotional prosody in congenital amusia rekindles the musical protolanguage hypothesisProceedings of the National Academy of Sciences, 2012
- Expression of Emotion in Eastern and Western Music Mirrors VocalizationPLOS ONE, 2012
- On the Time Course of Vocal Emotion RecognitionPLOS ONE, 2011
- There's more to emotion than meets the eye: A processing bias for neutral content in the domain of emotional prosodyCognition and Emotion, 2010
- Exploring the Sensitivity of Horn's Parallel Analysis to the Distributional Form of Random DataMultivariate Behavioral Research, 2009
- Neural processing of vocal emotion and identityBrain and Cognition, 2009
- PsychoPy—Psychophysics software in PythonJournal of Neuroscience Methods, 2007