DNN-based Emotion Recognition Based on Bottleneck Acoustic Features and Lexical Features
Authors:
- Eesung KimEKEesung Kim
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 6720-6724
Abstract
In this paper, we propose a novel emotion recognition method to reflect affect salient information using acoustic and lexical features. The acoustic features are extracted from the speech signal by applying statistical functionals of emotionally high-level features derived from Deep Neural Network (DNN). These acoustic features are early fused with two types of lexical features extracted from the text transcription of the speech signal, which are the distributed representation and affective lexicon-based dimensions. The fused features are fed to another DNN for utterance-level emotion classification. Experimental results on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) multimodal dataset showed 75.5% in unweighted accuracy recall, which outperformed the best results reported previously in the multimodal emotion recognition using acoustic and lexical features.Keywords
This publication has 14 references indexed in Scilit:
- Salience based lexical features for emotion recognition2017
- Deep Neural Network Bottleneck Features for Acoustic Event Recognition2016
- The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective ComputingIEEE Transactions on Affective Computing, 2015
- Speech emotion recognition with acoustic and lexical features2015
- i‐vector representation based on bottleneck features for language identificationElectronics Letters, 2013
- Norms of valence, arousal, and dominance for 13,915 English lemmasBehavior Research Methods, 2013
- Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challengeSpeech Communication, 2011
- Survey on speech emotion recognition: Features, classification schemes, and databasesPattern Recognition, 2011
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988