Emotional Speech Processing at the Intersection of Prosody and Semantics
Open Access
- 31 October 2012
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 7 (10) , e47279
Abstract
The ability to accurately perceive emotions is crucial for effective social interaction. Many questions remain regarding how different sources of emotional cues in speech (e.g., prosody, semantic information) are processed during emotional communication. Using a cross-modal emotional priming paradigm (Facial affect decision task), we compared the relative contributions of processing utterances with single-channel (prosody-only) versus multi-channel (prosody and semantic) cues on the perception of happy, sad, and angry emotional expressions. Our data show that emotional speech cues produce robust congruency effects on decisions about an emotionally related face target, although no processing advantage occurred when prime stimuli contained multi-channel as opposed to single-channel speech cues. Our data suggest that utterances with prosodic cues alone and utterances with combined prosody and semantic cues both activate knowledge that leads to emotional congruency (priming) effects, but that the convergence of these two information sources does not always heighten access to this knowledge during emotional speech processing.Keywords
This publication has 65 references indexed in Scilit:
- What is shared, what is different? Core relational themes and expressive displays of eight positive emotionsCognition and Emotion, 2013
- Multimodal human communication — Targeting facial expressions, speech content and prosodyNeuroImage, 2012
- On the Time Course of Vocal Emotion RecognitionPLOS ONE, 2011
- The effect of sublexical and lexical frequency on speech production: An fMRI investigationBrain and Language, 2009
- Investigating the Multimodal Nature of Human CommunicationJournal of Psychophysiology, 2009
- Language as context for the perception of emotionTrends in Cognitive Sciences, 2007
- On the role of attention for the processing of emotions in speech: Sex differences revisitedCognitive Brain Research, 2005
- Processing of affective prosody and lexical-semantics in spoken utterances as differentiated by event-related potentialsCognitive Brain Research, 2004
- Being Happy and Seeing ''Happy' ': Emotional State Mediates Visual Word RecognitionCognition and Emotion, 1997
- Facial expression and emotion.American Psychologist, 1993