Survey of Deep Representation Learning for Speech Emotion Recognition
Top Cited Papers
- 21 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 14 (2) , 1634-1654
Abstract
Traditionally, speech emotion recognition (SER) research has relied on manually handcrafted acoustic features using feature engineering. However, the design of handcrafted features for complex SER tasks requires significant manual eort, which impedes generalisability and slows the pace of innovation. This has motivated the adoption of representation learning techniques that can automatically learn an intermediate representation of the input signal without any manual feature engineering. Representation learning has led to improved SER performance and enabled rapid innovation. Its effectiveness has further increased with advances in deep learning (DL), which has facilitated \textit{deep representation learning} where hierarchical representations are automatically learned in a data-driven manner. This paper presents the first comprehensive survey on the important topic of deep representation learning for SER. We highlight various techniques, related challenges and identify important future areas of research. Our survey bridges the gap in the literature since existing surveys either focus on SER with hand-engineered features or representation learning in the general setting without focusing on SER.Keywords
All Related Versions
This publication has 179 references indexed in Scilit:
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Survey on speech emotion recognition: Features, classification schemes, and databasesPattern Recognition, 2011
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis.Psychological Bulletin, 1992
- Backpropagation through time: what it does and how to do itProceedings of the IEEE, 1990
- A learning algorithm for boltzmann machinesCognitive Science, 1985
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958