An Ensemble Framework of Voice-Based Emotion Recognition System for Films and TV Programs
Authors:
- 1 April 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 6209-6213
Abstract
Employing voice-based emotion recognition function in artificial intelligence (AI) product will improve the user experience. Most of researches that have been done only focus on the speech collected under controlled conditions. The scenarios evaluated in these research were well controlled. The conventional approach may fail when background noise or non-speech filler exist. In this paper, we propose an ensemble framework combining several aspects of features from audio. The framework incorporates gender and speaker information relying on multi-task learning. Therefore it is able to dig and capture emotional information as much as possible. This framework is evaluated on multimodal emotion challenge (MEC) 2017 corpus which is close to real world. The proposed framework outperformed the best baseline system by 29.5% (relative improvement).Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- The Opensesame NIST 2016 Speaker Recognition Evaluation System2017
- Bimodal Recurrent Neural Network for Audiovisual Voice Activity Detection2017
- Convolutional Recurrent Neural Networks for Polyphonic Sound Event DetectionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2017
- Automatic speech emotion recognition using recurrent neural networks with local attention2017
- DBN-ivector Framework for Acoustic Emotion Recognition2016
- End-to-end attention-based large vocabulary speech recognition2016
- A Multi-Task Learning Framework for Emotion Recognition Using 2D Continuous SpaceIEEE Transactions on Affective Computing, 2015
- On-line emotion recognition in a 3-D activation-valence-time continuum using acoustic and linguistic cuesJournal on Multimodal User Interfaces, 2009
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Analysis of emotion recognition using facial expressions, speech and multimodal information2004