Interdependencies among Voice Source Parameters in Emotional Speech
Authors:
- 9 June 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 2 (3) , 162-174
Abstract
Emotions have strong effects on the voice production mechanisms and consequently on voice characteristics. The magnitude of these effects, measured using voice source parameters, and the interdependencies among parameters have not been examined. To better understand these relationships, voice characteristics were analyzed in 10 actors' productions of a sustained/a/vowel in five emotions. Twelve acoustic parameters were studied and grouped according to their physiological backgrounds, three related to subglottal pressure, five related to the transglottal airflow waveform derived from inverse filtering the audio signal, and four related to vocal fold vibration. Each emotion appeared to possess a specific combination of acoustic parameters reflecting a specific mixture of physiologic voice control parameters. Features related to subglottal pressure showed strong within-group and between-group correlations, demonstrating the importance of accounting for vocal loudness in voice analyses. Multiple discriminant analysis revealed that a parameter selection that was based, in a principled fashion, on production processes could yield rather satisfactory discrimination outcomes (87.1 percent based on 12 parameters and 78 percent based on three parameters). The results of this study suggest that systems to automatically detect emotions use a hypothesis-driven approach to selecting parameters that directly reflect the physiological parameters underlying voice and speech production.Keywords
This publication has 25 references indexed in Scilit:
- Mapping emotions into acoustic space: The role of voice productionBiological Psychology, 2011
- Predicted Singers' Vocal Fold Lengths and Voice Classification—A Study of X-Ray Morphological MeasuresJournal of Voice, 2009
- The World of Emotions is not Two-DimensionalPsychological Science, 2007
- Emotions in [a]: A perceptual and acoustic studyLogopedics Phoniatrics Vocology, 2006
- Estimating perceived phonatory pressedness in singing from flow glottogramsJournal of Voice, 2004
- Toward machine emotional intelligence: analysis of affective physiological stateIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Glottal characteristics of female speakers: Acoustic correlatesThe Journal of the Acoustical Society of America, 1997
- Multidimensional comparisons of structures of vocally and facially expressed emotionPerception & Psychophysics, 1975
- Loudness, Sound Pressure, and Subglottal Pressure in SpeechThe Journal of the Acoustical Society of America, 1963