A Novel Algorithmic Structure of EEG Channel Attention Combined With Swin Transformer for Motor Patterns Classification
Open Access
- 21 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 31 (15344320) , 3132-3141
Abstract
With the development of brain-computer interfaces (BCI) technologies, EEG-based BCI applications have been deployed for medical purposes. Motor imagery (MI), applied to promote neural rehabilitation for stroke patients, is among the most common BCI paradigms that. The Electroencephalogram (EEG) signals, encompassing an extensive range of channels, render the training dataset a high-dimensional construct. This high dimensionality, inherent in such a dataset, tends to challenge traditional deep learning approaches, causing them to potentially disregard the intrinsic correlations amongst these channels. Such an oversight often culminates in erroneous data classification, presenting a significant drawback of these conventional methodologies. In our study, we propose a novel algorithmic structure of EEG channel-attention combined with Swin Transformer for motor pattern recognition in BCI rehabilitation. Effectively, the self-attention module from transformer architecture could captures temporal-spectral-spatial features hidden in EEG data. The experimental results verify that our proposed methods outperformed other state-of-art approaches with the average accuracy of 87.67%. It is implied that our method can extract high-level and latent connections among temporal-spectral features in contrast to traditional deep learning methods. This paper demonstrates that channel-attention combined with Swin Transformer methods has great potential for implementing high-performance motor pattern-based BCI systems.Keywords
Funding Information
- National Natural Science Young Foundation of China (62102242)
- Shanghai Education Research Program (C2022152)
- National Key Research Development Program of China (2018YFC2002300, 2018YFC2002301)
- Project of Jiangxu Health Commission (Z2022012)
This publication has 41 references indexed in Scilit:
- T test as a parametric statisticKorean Journal of Anesthesiology, 2015
- Common spatial pattern and linear discriminant analysis for motor imagery classification2013
- Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2bFrontiers in Neuroscience, 2012
- Clustering technique-based least square support vector machine for EEG signal classificationComputer Methods and Programs in Biomedicine, 2011
- EEG signal classification using PCA, ICA, LDA and support vector machinesExpert Systems with Applications, 2010
- Could Anyone Use a BCI?2010
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigmsIEEE Transactions on Biomedical Engineering, 2004
- Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciencesAtmospheric Environment, 1998
- Optimal unsupervised learning in a single-layer linear feedforward neural networkNeural Networks, 1989