Ali Harimi

Speech emotion recognition (SER) is a challenging field of research that has attracted research during the last two decades. Successful performance of Deep Convolutional Neural Networks (DNNs) in various difficult pattern recognition problems motivates researchers to develop SER systems based on deep learning algorithms. The most essential requirement in training a deep model is the presence of a large-scale dataset. However, in many cases, such an amount of data is not available. Transfer learning approaches provide a practical solution to this problem. In this paper, we proposed an SER system based on AlexNet, the well-known deep model trained on the large-scale ImageNet dataset. In this way, the novel enriched spectrogram calculated based on the fusion of wide-band and narrow-band spectrograms is developed as a proper input for such a model. The proposed fused spectrogram benefited from both high temporal and spectral resolution. These images have been applied to the pre-trained AlexNet. All the experiments were performed on the popular Emo-DB, IEMOCAP, and eNTERFACE05 datasets based on 10-fold cross-validation and Leave-One-Speaker-Group-Out known as speaker-dependent and speaker-independent techniques, respectively. The proposed approach gains competent performance in contrast to other state-of-the-art methods.

Due to the high level of precision and remarkable capabilities to solve the intricate problems in industry and academia, convolutional neural networks (CNNs) are presented. Speech emotion recognition is an interesting application for CNNs in the field of audio processing. In this paper, a speech emotion recognition system based on a 3D CNN is suggested to analyze and classify the emotions. In the proposed method, the three-dimensional reconstructed phase spaces of the speech signals were calculated. Then, emotion-related patterns formed in these spaces were converted into 3D tensors. Accordingly, a 3D CNN for speech emotion recognition applied to two datasets, EMO-DB and eNTERFACE05, using a speaker-independent technique achieved 90.40% and 82.20% accuracy, respectively. By employing gender recognition, the accuracy rates on EMO-DB increased to 94.42% and on eNTERFACE05 rose to 88.47%. Realization of the introduced 3D CNN on both Intel CPU and NVIDIA GPU is also explored. The results of the implemented 3D CNN without and with regard to gender recognition show that GPU-based running is faster for the EMO-DB and eNTERFACE05 datasets than CPU-based executions (using Python).