Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks
Preprint
Abstract
One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein, we propose a novel approach for learning such representations from multi-channel EEG time-series, and demonstrate its advantages in the context of mental load classification task. First, we transform EEG activities into a sequence of topology-preserving multi-spectral images, as opposed to standard EEG analysis techniques that ignore such spatial information. Next, we train a deep recurrent-convolutional network inspired by state-of-the-art video classification to learn robust representations from the sequence of images. The proposed approach is designed to preserve the spatial, spectral, and temporal structure of EEG which leads to finding features that are less sensitive to variations and distortions within each dimension. Empirical evaluation on the cognitive load classification task demonstrated significant improvements in classification accuracy over current state-of-the-art approaches in this field.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Large-Scale Video Classification with Convolutional Neural Networks2014
- EEG signal classification using PCA, ICA, LDA and support vector machinesExpert Systems with Applications, 2010
- Classification of patterns of EEG synchronization for seizure predictionClinical Neurophysiology, 2009
- Recurrent neural networks employing Lyapunov exponents for EEG signals classificationExpert Systems with Applications, 2005
- Frontal midline EEG dynamics during working memoryNeuroImage, 2005
- Frontal theta activity in humans increases with memory load in a working memory taskEuropean Journal of Neuroscience, 2002
- Sustained and transient oscillatory responses in the gamma and beta bands in a visual short-term memory task in humansVisual Neuroscience, 1999
- Cognitive Architecture and Instructional DesignEducational Psychology Review, 1998
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- A trivariate clough—tocher scheme for tetrahedral dataComputer Aided Geometric Design, 1984