3D convolutional neural network based on spatial-spectral feature pictures learning for decoding motor imagery EEG signal
Open Access
- 10 December 2024
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neurorobotics
- Vol. 18, 1485640
Abstract
Non-invasive brain-computer interfaces (BCI) hold great promise in the field of neurorehabilitation. They are easy to use and do not require surgery, particularly in the area of motor imagery electroencephalography (EEG). However, motor imagery EEG signals often have a low signal-to-noise ratio and limited spatial and temporal resolution. Traditional deep neural networks typically only focus on the spatial and temporal features of EEG, resulting in relatively low decoding and accuracy rates for motor imagery tasks. To address these challenges, this paper proposes a 3D Convolutional Neural Network (P-3DCNN) decoding method that jointly learns spatial-frequency feature maps from the frequency and spatial domains of the EEG signals. First, the Welch method is used to calculate the frequency band power spectrum of the EEG, and a 2D matrix representing the spatial topology distribution of the electrodes is constructed. These spatial-frequency representations are then generated through cubic interpolation of the temporal EEG data. Next, the paper designs a 3DCNN network with 1D and 2D convolutional layers in series to optimize the convolutional kernel parameters and effectively learn the spatial-frequency features of the EEG. Batch normalization and dropout are also applied to improve the training speed and classification performance of the network. Finally, through experiments, the proposed method is compared to various classic machine learning and deep learning techniques. The results show an average decoding accuracy rate of 86.69%, surpassing other advanced networks. This demonstrates the effectiveness of our approach in decoding motor imagery EEG and offers valuable insights for the development of BCI.Keywords
This publication has 34 references indexed in Scilit:
- CTRAN: CNN-Transformer-based network for natural language understandingEngineering Applications of Artificial Intelligence, 2023
- BCI–VR-Based Hand Soft Rehabilitation System with Its Applications in Hand Rehabilitation After StrokeInternational Journal of Precision Engineering and Manufacturing, 2023
- Convolutional neural network with support vector machine for motor imagery EEG signal classificationMultimedia Tools and Applications, 2023
- A VR-based BCI interactive system for UAV swarm controlBiomedical Signal Processing and Control, 2023
- Overall optimization of CSP based on ensemble learning for motor imagery EEG decodingBiomedical Signal Processing and Control, 2022
- Motor imagery EEG classification algorithm based on CNN-LSTM feature fusion networkBiomedical Signal Processing and Control, 2022
- An efficient multi-scale CNN model with intrinsic feature integration for motor imagery EEG subject classification in brain-machine interfacesBiomedical Signal Processing and Control, 2022
- EEG-based motor imagery classification using digraph Fourier transforms and extreme learning machinesBiomedical Signal Processing and Control, 2021
- Deep Learning with ConvNet Predicts Imagery Tasks Through EEGNeural Processing Letters, 2021
- Deep learning for motor imagery EEG-based classification: A reviewBiomedical Signal Processing and Control, 2021