Emotion Recognition from Speech
Authors:
- Kannan VenkataramananKVKannan Venkataramanan
- Haresh Rengaraj RajamohanHRHaresh Rengaraj Rajamohan
Preprint
Abstract
In this work, we conduct an extensive comparison of various approaches to speech based emotion recognition systems. The analyses were carried out on audio recordings from Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS). After pre-processing the raw audio files, features such as Log-Mel Spectrogram, Mel-Frequency Cepstral Coefficients (MFCCs), pitch and energy were considered. The significance of these features for emotion classification was compared by applying methods such as Long Short Term Memory (LSTM), Convolutional Neural Networks (CNNs), Hidden Markov Models (HMMs) and Deep Neural Networks (DNNs). On the 14-class (2 genders x 7 emotions) classification task, an accuracy of 68% was achieved with a 4-layer 2 dimensional CNN using the Log-Mel Spectrogram features. We also observe that, in emotion recognition, the choice of audio features impacts the results much more than the model complexity.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Convolutional Neural Network Techniques for Speech Emotion Recognition2018
- The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American EnglishPLOS ONE, 2018
- Emotion Recognition and Classification in Speech using Artificial Neural NetworksInternational Journal of Computer Applications, 2016
- Evaluation of PNCC and extended spectral subtraction methods for robust speech recognition2015
- Acoustic Emotion Recognition Using Linear and Nonlinear Cepstral CoefficientsInternational Journal of Advanced Computer Science and Applications, 2015
- A review of paralinguistic information processing for natural speech communicationAcoustical Science and Technology, 2013
- 3D Convolutional Neural Networks for Human Action RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Survey on speech emotion recognition: Features, classification schemes, and databasesPattern Recognition, 2011
- Hidden Markov model-based speech emotion recognition2003
- A Scale for the Measurement of the Psychological Magnitude PitchThe Journal of the Acoustical Society of America, 1937