Continuous Emotion Recognition during Music Listening Using EEG Signals: A Fuzzy Parallel Cascades Model
Preprint
Abstract
A controversial issue in artificial intelligence is human emotion recognition. This paper presents a fuzzy parallel cascades (FPC) model for predicting the continuous subjective appraisal of the emotional content of music by time-varying spectral content of EEG signals. The EEG, along with an emotional appraisal of 15 subjects, was recorded during listening to seven musical excerpts. The emotional appraisement was recorded along the valence and arousal emotional axes as a continuous signal. The FPC model was composed of parallel cascades with each cascade containing a fuzzy logic-based system. The FPC model performance was evaluated by comparing with linear regression (LR), support vector regression (SVR) and Long Short Term Memory recurrent neural network (LSTM RNN) models. The RMSE of the FPC was lower than other models for the estimation of both valence and arousal of all musical excerpts. The lowest RMSE was 0.089 which was obtained in estimation of the valence of MS4 by the FPC model. The analysis of MI of frontal EEG with the valence confirms the role of frontal channels in theta frequency band in emotion recognition. Considering the dynamic variations of musical features during songs, employing a modeling approach to predict dynamic variations of the emotional appraisal can be a plausible substitute for the classification of musical excerpts into predefined labels.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Synchrosqueezing transform based feature extraction from EEG signals for emotional state predictionBiomedical Signal Processing and Control, 2019
- Fuzzy descriptive evaluation system: real, complete and fair evaluation of studentsSoft Computing, 2019
- A New Threshold Selection Method Based on Fuzzy Expert Systems for Separating Text from the Background of Document ImagesIranian Journal of Science and Technology, Transactions of Electrical Engineering, 2018
- Music induced emotion using wavelet packet decomposition—An EEG studyBiomedical Signal Processing and Control, 2018
- Toward automatic detection of brain responses to emotional music through analysis of EEG effective connectivityComputers in Human Behavior, 2016
- What hemodynamic (fNIRS), electrophysiological (EEG) and autonomic integrated measures can tell us about emotional processingBrain and Cognition, 2015
- Individual differences in anterior EEG asymmetry: methodological problems and solutionsBiological Psychology, 2004
- Nonlinear Dynamic Modeling of Physiological Systems2004
- A Wavelet Tour of Signal Processing1999
- Parallel cascade identification and kernel estimation for nonlinear systemsAnnals of Biomedical Engineering, 1991