Articulatory-Acoustic Analyses of Mandarin Words in Emotional Context Speech for Smart Campus
Authors:
Open Access
- 16 August 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 6, 48418-48427
Abstract
Recent years, along with the promotion of smart campus, social networks developed rapidly which demands high accuracy of man-man & man-machine interaction technologies. Thus, physiological information in speech interactive processing has become an important complement or even replaced acousticbased features. With the aim of assessing the influence of emotions on articulatory-acoustic features in speech production, the current study explored the articulatory mechanism that underlying emotional speech production of Mandarin words. We first used the AG501 EMA device to collect articulatory and acoustic data synchronously as subjects were speaking specific words in Mandarin with different emotions, e.g., anger, sadness, happiness, and neutral; articulatory and acoustic features then were extracted from the collected data and analyzed in a one-way ANOVA to discover the significance of emotions on articulatory and acoustic features. The results illustrated that the motion of articulators (tongue and lip) were influenced by emotions significantly; in detail, the motion range of tongue and lip with anger were larger than other emotions, meanwhile, tongue speed and lip speed with anger and happiness were more sensitive than with sadness and neutral in emotional words. Results had been discussed to discover the relationship between acoustic and articulatory features of emotional speech, and then the conclusion can be acquired that articulatory motion feature (tongue and lip) may be the major feature of emotional speech recognition, so that which can be applied to the man-machine interaction of smart campus research in the future.Keywords
Funding Information
- National Natural Science Foundation of China (61371193)
- Natural Science Foundation for Young Scientists of Shanxi Province, China (201701D221117, 201601D202045)
- Applied Basic Foundation of Shanxi Province, China (201601D202045)
- Taiyuan University of Technology (2016QN24)
This publication has 21 references indexed in Scilit:
- Automatic intelligibility classification of sentence-level pathological speechComputer Speech & Language, 2015
- Real-time magnetic resonance imaging and electromagnetic articulography database for speech production research (TC)The Journal of the Acoustical Society of America, 2014
- The multisensory perception of co-speech gestures – A review and meta-analysis of neuroimaging studiesJournal of Neurolinguistics, 2014
- Tongue kinematics in palate relative coordinate spaces for electro-magnetic articulographyThe Journal of the Acoustical Society of America, 2014
- The effect of phonetic context on speech movements in repetitive speechThe Journal of the Acoustical Society of America, 2013
- Lip and tongue movements during phonetic sequences: analysis and definition of normal valuesEuropean Journal of Orthodontics, 2011
- An Analysis of HMM-based prediction of articulatory movementsSpeech Communication, 2010
- Comparison of emotion perception among different culturesAcoustical Science and Technology, 2010
- Accuracy Assessment for AG500, Electromagnetic ArticulographJournal of Speech, Language, and Hearing Research, 2009
- Calorie restriction extends yeast life span by lowering the level of NADHGenes & Development, 2004