Attention-Based DSC-ConvLSTM for Multiclass Motor Imagery Classification
Authors:
Open Access
- 5 May 2022
- journal article
- research article
- Published by Hindawi Limited in Computational Intelligence and Neuroscience
- Vol. 2022, 1-13
Abstract
With the rapid development of deep learning, researchers have gradually applied it to motor imagery brain computer interface (MI-BCI) and initially demonstrated its advantages over traditional machine learning. However, its application still faces many challenges, and the recognition rate of electroencephalogram (EEG) is still the bottleneck restricting the development of MI-BCI. In order to improve the accuracy of EEG classification, a DSC-ConvLSTM model based on the attention mechanism is proposed for the multi-classification of motor imagery EEG signals. To address the problem of the small sample size of well-labeled and accurate EEG data, the preprocessing uses sliding windows for data augmentation, and the average prediction loss of each sliding window is used as the final prediction loss for that trial. This not only increases the training sample size and is beneficial to train complex neural network models, but also the network no longer extracts the global features of the whole trial so as to avoid learning the difference features among trials, which can effectively eliminate the influence of individual specificity. In the aspect of feature extraction and classification, the overall network structure is designed according to the characteristics of the EEG signals in this paper. Firstly, depth separable convolution (DSC) is used to extract spatial features of EEG signals. On the one hand, this reduces the number of parameters and improves the response speed of the system. On the other hand, the network structure we designed is more conducive to extract directly the direct extraction of spatial features of EEG signals. Secondly, the internal structure of the Long Short-Term Memory (LSTM) unit is improved by using convolution and attention mechanism, and a novel bidirectional convolution LSTM (ConvLSTM) structure is proposed by comparing the effects of embedding convolution and attention mechanism in the input and different gates, respectively. In the ConvLSTM module, the convolutional structure is only introduced into the input-to-state transition, while the gates still remain the original fully connected mechanism, and the attention mechanism is introduced into the input to further improve the overall decoding performance of the model. This bidirectional ConvLSTM extracts the time-domain features of EEG signals and integrates the feature extraction capability of the CNN and the sequence processing capability of LSTM. The experimental results show that the average classification accuracy of the model reaches 73.7% and 92.6% on two datasets, BCI Competition IV Dataset 2a and High Gamma Dataset, respectively, which proves the robustness and effectiveness of the model we proposed. It can be seen that the model in this paper can deeply excavate significant EEG features from the original EEG signals, show good performance in different subjects and different datasets, and improve the influence of individual variability on the classification performance, which is of practical significance for promoting the development of brain-computer interface technology towards a practical and marketable direction.Keywords
Funding Information
- Ministry of Science and Technology of China (2018ZX03001014-003)
This publication has 19 references indexed in Scilit:
- Deep learning with convolutional neural networks for EEG decoding and visualizationHuman Brain Mapping, 2017
- A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann MachinesIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016
- Review of the BCI Competition IVFrontiers in Neuroscience, 2012
- Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2bFrontiers in Neuroscience, 2012
- Movement related activity in the high gamma range of the human EEGNeuroImage, 2008
- Application of multivariate autoregressive modeling for analyzing the interaction between EEG and EMG in humansInternational Congress Series, 2004
- BCI2000: A General-Purpose Brain-Computer Interface (BCI) SystemIEEE Transactions on Biomedical Engineering, 2004
- Brain–computer interfaces for communication and controlClinical Neurophysiology, 2002
- Optimal spatial filtering of single trial EEG during imagined hand movementIEEE Transactions on Rehabilitation Engineering, 2000
- Event-related EEG/MEG synchronization and desynchronization: basic principlesClinical Neurophysiology, 1999