Automated robust human emotion classification system using hybrid EEG features with ICBrainDB dataset
- 10 November 2022
- journal article
- research article
- Published by Springer Nature in Health Information Science and Systems
- Vol. 10 (1) , 1-14
Abstract
Emotion identification is an essential task for human–computer interaction systems. Electroencephalogram (EEG) signals have been widely used in emotion recognition. So far, there have been several EEG-based emotion recognition datasets that the researchers have used to validate their developed models. Hence, we have used a new ICBrainDB EEG dataset to classify angry, neutral, happy, and sad emotions in this work. Signal processing-based wavelet transform (WT), tunable Q-factor wavelet transform (TQWT), and image processing-based histogram of oriented gradients (HOG), local binary pattern (LBP), and convolutional neural network (CNN) features have been used extracted from the EEG signals. The WT is used to extract the rhythms from each channel of the EEG signal. The instantaneous frequency and spectral entropy are computed from each EEG rhythm signal. The average, and standard deviation of instantaneous frequency, and spectral entropy of each rhythm of the signal are the final feature vectors. The spectral entropy in each channel of the EEG signal after performing the TQWT is used to create the feature vectors in the second signal side method. Each EEG channel is transformed into time–frequency plots using the synchrosqueezed wavelet transform. Then, the feature vectors are constructed individually using windowed HOG and LBP features. Also, each channel of the EEG data is fed to a pretrained CNN to extract the features. In the feature selection process, the ReliefF feature selector is employed. Various feature classification algorithms namely, k-nearest neighbor (KNN), support vector machines, and neural networks are used for the automated classification of angry, neutral, happy, and sad emotions. Our developed model obtained an average accuracy of 90.7% using HOG features and a KNN classifier with a tenfold cross-validation strategy.Keywords
This publication has 24 references indexed in Scilit:
- A EEG-based emotion recognition model with rhythm and time characteristicsBrain Informatics, 2019
- Validation of Emotiv EPOC+ for extracting ERP correlates of emotional face processingBiocybernetics and Biomedical Engineering, 2018
- Wavelet Transform With Tunable Q-FactorIEEE Transactions on Signal Processing, 2011
- Synchrosqueezed wavelet transforms: An empirical mode decomposition-like toolApplied and Computational Harmonic Analysis, 2011
- ImageNet: A large-scale hierarchical image database2009
- Spectral entropy: A complementary index for rolling element bearing performance degradation assessmentProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, 2008
- Mixed-Band Wavelet-Chaos-Neural Network Methodology for Epilepsy and Epileptic Seizure DetectionIEEE Transactions on Biomedical Engineering, 2007
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Overcoming the Myopia of Inductive Learning Algorithms with RELIEFFApplied Intelligence, 1997
- Estimating and interpreting the instantaneous frequency of a signal. I. FundamentalsProceedings of the IEEE, 1992