E2T: EEG-to-Trajectory Transformer for Motor Imagery-Based Fully-DoF Motion Prediction
Open Access
- 13 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 34 (15344320) , 1961-1973
Abstract
Brain–computer interfaces (BCIs) using electroen-cephalography (EEG) enable non-invasive, real-time interaction for individuals with motor impairments by decoding neural signals associated with movement intention. Although traditional classification-based motor imagery (MI) BCIs translate discrete EEG patterns into predefined commands, such approaches inherently lack the flexibility required for continuous and naturalistic movement control. To overcome these limitations, we propose a novel EEG-based decoding framework that directly predicts continuous 3D upper limb trajectories using a hybrid deep learning architecture. The model integrates frequency-adaptive Sinc convolutional filters, a Transformer-based temporal encoder, and ensemble learning to extract meaningful spatiotemporal features from raw EEG signals. To ensure balanced spatial coverage, we developed a task-specific experimental paradigm in which each trial comprised sequential motor execution (ME) and MI phases based on one of four predefined 3D directions: forward–vertical, forward–leftward, forward–rightward, and lateral–vertical. The MI phase was placed after the ME phase to reinforce vivid internal representations of movement. This approach allowed the model to capture continuous 3D trajectories across the X, Y, and Z axes without directional bias. Comprehensive evaluation under both ME and MI conditions demonstrates robust decoding performance, achieving average correlation coefficients of 0.7728 (ME) and 0.7110 (MI), significantly outperforming existing baseline models. Furthermore, the framework generalizes well to unseen MI tasks, demonstrating its feasibility for real-world deployment in assistive neuroprosthetic systems with a reduced calibration session.Keywords
Funding Information
- Institute of Information & Communications Technology Planning & Evaluation (IITP) under the Artificial Intelligence Graduate School Program (RS-2019-II190079)
- Artificial Intelligence Star Fellowship Support Program for nurturing top talents (IITP-2025-RS-2025-02304828)
- Ministry of Science and ICT (MSIT), Republic of Korea
This publication has 50 references indexed in Scilit:
- Towards unlocking motor control in spinal cord injured by applying an online EEG-based framework to decode motor intention, trajectory and error processingScientific Reports, 2024
- A shallow mirror transformer for subject-independent motor imagery BCIComputers in Biology and Medicine, 2023
- Multiscale time-frequency method for multiclass Motor Imagery Brain Computer InterfaceComputers in Biology and Medicine, 2022
- An exoskeleton controlled by an epidural wireless brain–machine interface in a tetraplegic patient: a proof-of-concept demonstrationThe Lancet Neurology, 2019
- Motor imagery involves predicting the sensory consequences of the imagined movementNature Communications, 2018
- Provision of somatosensory inputs during motor imagery enhances learning-induced plasticity in human motor cortexScientific Reports, 2017
- Deep learning with convolutional neural networks for EEG decoding and visualizationHuman Brain Mapping, 2017
- Brain–computer interfaces for communication and rehabilitationNature Reviews Neurology, 2016
- Reach and grasp by people with tetraplegia using a neurally controlled robotic armNature, 2012
- Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageriesClinical Neurophysiology, 2008