Deep Riemannian Networks for EEG Decoding
Preprint
Abstract
State-of-the-art performance in electroencephalography (EEG) decoding tasks is currently often achieved with either Deep-Learning (DL) or Riemannian-Geometry-based decoders (RBDs). Recently, there is growing interest in Deep Riemannian Networks (DRNs) possibly combining the advantages of both previous classes of methods. However, there are still a range of topics where additional insight is needed to pave the way for a more widespread application of DRNs in EEG. These include architecture design questions such as network size and end-to-end ability.How these factors affect model performance has not been explored. Additionally, it is not clear how the data within these networks is transformed, and whether this would correlate with traditional EEG decoding. Our study aims to lay the groundwork in the area of these topics through the analysis of DRNs for EEG with a wide range of hyperparameters. Networks were tested on two public EEG datasets and compared with state-of-the-art ConvNets. Here we propose end-to-end EEG SPDNet (EE(G)-SPDNet), and we show that this wide, end-to-end DRN can outperform the ConvNets, and in doing so use physiologically plausible frequency regions. We also show that the end-to-end approach learns more complex filters than traditional band-pass filters targeting the classical alpha, beta, and gamma frequency bands of the EEG, and that performance can benefit from channel specific filtering approaches. Additionally, architectural analysis revealed areas for further improvement due to the possible loss of Riemannian specific information throughout the network. Our study thus shows how to design and train DRNs to infer task-related information from the raw EEG without the need of handcrafted filterbanks and highlights the potential of end-to-end DRNs such as EE(G)-SPDNet for high-performance EEG decoding.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Riemannian geometry for combining functional connectivity metrics and covariance in BCISoftware Impacts, 2022
- Second-Order Convolutional Neural Network Based on Cholesky Compression Strategy2021
- Array programming with NumPyNature, 2020
- SciPy 1.0: fundamental algorithms for scientific computing in PythonNature Methods, 2020
- Riemannian Geometric Statistics in Medical Image Analysis2020
- Second-Order Networks in PyTorch2019
- DeepKSPD: Learning Kernel-Matrix-Based SPD Representation For Fine-Grained Image Recognition2018
- An embedded implementation based on adaptive filter bank for brain–computer interface systemsJournal of Neuroscience Methods, 2018
- Deep learning with convolutional neural networks for EEG decoding and visualizationHuman Brain Mapping, 2017
- Movement related activity in the high gamma range of the human EEGNeuroImage, 2008