Decoding Hand Motor Imagery Tasks Within the Same Limb From EEG Signals Using Deep Learning
Open Access
- 21 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Robotics and Bionics
- Vol. 2 (4) , 692-699
Abstract
Motor imagery (MI) tasks of different body parts have been successfully decoded by conventional classifiers, such as LDA and SVM. On the other hand, decoding MI tasks within the same limb is a challenging problem with these classifiers; however, it would provide more options to control robotic devices. This work proposes to improve the hand MI tasks decoding within the same limb in a brain-computer interface using convolutional neural networks (CNNs); the CNN EEGNet, LDA, and SVM classifiers were evaluated for two (flexion/extension) and three (flexion/extension/grasping) MI tasks. Our approach is the first attempt to apply CNNs for solving this problem to our best knowledge. In addition, visual and electrotactile stimulation were included as BCI training reinforcement after the MI task similar to feedback sessions; then, they were compared. The EEGNet achieved maximum mean accuracies of 78.46% (± 12.50%) and 76.72% (± 11.67%) for two and three classes, respectively. Outperforming conventional classifiers with results around 60% and 48%, and similar works with results lower than 67% and 75%, respectively. Moreover, the electrical stimulation over the visual stimulus was not significant during the calibration session. The deep learning scheme enhanced the decoding of MI tasks within the same limb against the conventional framework.Keywords
Funding Information
- Fondecyt from Concytec, Peru (112-2017)
- Japan Society for the Promotion of Science Grant-in-Aid for Scientific Research (18H04063)
This publication has 43 references indexed in Scilit:
- A Brain-Computer Interface Based Cognitive Training System for Healthy Elderly: A Randomized Control Pilot Study for Usability and Preliminary EfficacyPLOS ONE, 2013
- Motor Control and Neural Plasticity through Interhemispheric InteractionsNeural Plasticity, 2012
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- EPS Mid-Career Award 2009: From Observation to Action Simulation: The Role of Attention, Eye-Gaze, Emotion, and Body StateQuarterly Journal of Experimental Psychology, 2010
- Within-limb somatotopy in primary motor cortex – revealed using fMRICortex, 2010
- Hemispheric Differences in the Relationship Between Corticomotor Excitability Changes Following a Fine-Motor Task and Motor LearningJournal of Neurophysiology, 2004
- Motor imagery and direct brain-computer communicationProceedings of the IEEE, 2001
- The mental prosthesis: assessing the speed of a P300-based brain-computer interfaceIEEE Transactions on Rehabilitation Engineering, 2000
- Enhancement of Left-Right Sensorimotor EEG Differences During Feedback-Regulated Motor ImageryJournal Of Clinical Neurophysiology, 1999
- Shared Neural Substrates Controlling Hand Movements in Human Motor CortexScience, 1995