Emotion Recognition from Speech in a Subject-Independent Approach
Open Access
- 20 June 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (13) , 6958
Abstract
The aim of this article is to critically and reliably assess the potential of current emotion recognition technologies for practical applications in human–computer interaction (HCI) systems. The study made use of two databases: one in English (RAVDESS) and another in Polish (EMO-BAJKA), both containing speech recordings expressing various emotions. The effectiveness of recognizing seven and eight different emotions was analyzed. A range of acoustic features, including energy features, mel-cepstral features, zero-crossing rate, fundamental frequency, and spectral features, were utilized to analyze the emotions in speech. Machine learning techniques such as convolutional neural networks (CNNs), long short-term memory (LSTM) networks, and support vector machines with a cubic kernel (cubic SVMs) were employed in the emotion classification task. The research findings indicated that the effective recognition of a broad spectrum of emotions in a subject-independent approach is limited. However, significantly better results were obtained in the classification of paired emotions, suggesting that emotion recognition technologies could be effectively used in specific applications where distinguishing between two particular emotional states is essential. To ensure a reliable and accurate assessment of the emotion recognition system, care was taken to divide the dataset in such a way that the training and testing data contained recordings of completely different individuals. The highest classification accuracies for pairs of emotions were achieved for Angry–Fearful (0.8), Angry–Happy (0.86), Angry–Neutral (1.0), Angry–Sad (1.0), Angry–Surprise (0.89), Disgust–Neutral (0.91), and Disgust–Sad (0.96) in the RAVDESS. In the EMO-BAJKA database, the highest classification accuracies for pairs of emotions were for Joy–Neutral (0.91), Surprise–Neutral (0.80), Surprise–Fear (0.91), and Neutral–Fear (0.91).Keywords
This publication has 79 references indexed in Scilit:
- Speech emotion recognition by using complex MFCC and deep sequential modelMultimedia Tools and Applications, 2022
- Machine learning techniques for speech emotion recognition using paralinguistic acoustic featuresInternational Journal of Speech Technology, 2022
- Using emotion recognition technologies to teach children with autism spectrum disorder how to identify and express emotionsUniversal Access in the Information Society, 2021
- Deep learning approaches for speech emotion recognition: state of the art and research challengesMultimedia Tools and Applications, 2021
- Pitch-synchronous single frequency filtering spectrogram for speech emotion recognitionMultimedia Tools and Applications, 2020
- Multimodal speech emotion recognition and classification using convolutional neural network techniquesInternational Journal of Speech Technology, 2020
- Excitation Features of Speech for Emotion Recognition Using Neutral Speech as ReferenceCircuits, Systems, and Signal Processing, 2020
- Feature extraction algorithms to improve the speech emotion recognition rateInternational Journal of Speech Technology, 2020
- Emotion recognition from speech: a reviewInternational Journal of Speech Technology, 2012
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008