Online Learning for Wearable EEG-based Emotion Classification
Preprint
- 9 January 2023
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Emotions are indicators of affective states and play a significant role in human daily life, behavior, and interactions. Giving emotional intelligence to the machines could, for instance, facilitate early detection and prediction of (mental) diseases and symptoms. Electroencephalography (EEG) -based emotion recognition is being widely applied because it measures electrical correlates directly from the brain rather than the indirect measurement of other physiological responses initiated by the brain. The recent development of non-invasive and portable EEG sensors makes it possible to use them in real-time applications. Therefore, this paper presents a real-time emotion classification pipeline, which trains different binary classifiers for the dimensions of Valence and Arousal from an incoming EEG data stream. After achieving a 23.9% (Arousal) and 25.8% (Valence) higher f1-score on the state-of-art AMIGOS dataset, this pipeline was applied to the dataset achieved by an emotion elicitation experimental framework developed within the scope of this thesis. Following two different protocols, 15 participants were recorded using two different consumer-grade EEG devices while watching 16 short emotional videos in a controlled environment. For an immediate label setting, the mean f1-score of 87% and 82% were achieved for Arousal and Valence, respectively. In a live scenario, while continuously being updated on the incoming data stream with delayed labels, the pipeline proved to be fast enough to achieve predictions in real time. However, the significant discrepancy from the readily available labels on the classification scores leads to future work to include more data with frequent delayed labels in the live settings.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Delayed labelling evaluation for data streamsData Mining and Knowledge Discovery, 2019
- Which Reference Should We Use for EEG and ERP practice?Brain Topography, 2019
- Adaptive random forests for evolving data stream classificationMachine Learning, 2017
- Self-control of epileptic seizures by nonpharmacological strategiesEpilepsy & Behavior, 2016
- Clinical features of the pre-ictal state: Mood changes and premonitory symptomsEpilepsy & Behavior, 2012
- Prodromal symptoms in epileptic patients: Clinical characterization of the pre-ictal phaseSeizure: European Journal of Epilepsy, 2009
- Seizure anticipation by patients with focal and generalized epilepsy: A multicentre assessment of premonitory symptomsEpilepsy Research, 2006
- Emotion recognition in human-computer interactionIEEE Signal Processing Magazine, 2001
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994
- The spatial location of EEG electrodes: locating the best-fitting sphere relative to cortical anatomyElectroencephalography and Clinical Neurophysiology, 1993