A Novel Hybrid Brain-Computer Interface Combining Motor Imagery and Intermodulation Steady-State Visual Evoked Potential
Open Access
- 3 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 30 (15344320) , 1525-1535
Abstract
The hybrid brain-computer interface (hBCI) combining motor imagery (MI) and steady-state visual evoked potential (SSVEP) has been proven to have better performance than a pure MI- or SSVEP-based brain-computer interface (BCI). In most studies on hBCIs, subjects have been required to focus their attention on flickering light-emitting diodes (LEDs) or blocks while imagining body movements. However, these two classical tasks performed concurrently have a poor correlation. Therefore, it is necessary to reduce the task complexity of such a system and improve its user-friendliness. Aiming to achieve this goal, this study proposes a novel hybrid BCI that combines MI and intermodulation SSVEPs. In the proposed system, images of both hands flicker at the same frequency (i.e., 30 Hz) but at different grasp frequencies (i.e., 1 Hz for the left hand, and 1.5 Hz for the right hand), resulting in different intermodulation frequencies for encoding targets. Additionally, movement observation for subjects can help to perform the MI task better. In this study, two types of brain signals are classified independently and then fused by a scoring mechanism based on the probability distribution of relevant parameters. The online verification results showed that the average accuracies of 12 healthy subjects and 11 stroke patients were 92.40 ± 7.45% and 73.07 ± 9.07%, respectively. The average accuracies of 10 healthy subjects in the MI, SSVEP, and hybrid tasks were 84.00 ± 12.81%, 80.75 ± 8.08%, and 89.00 ± 9.94%, respectively. The high recognition accuracy verifies the feasibility and robustness of the proposed system. This study provides a novel and natural paradigm for a hybrid BCI based on MI and SSVEP.Keywords
Funding Information
- National Natural Science Foundation of China (62171473)
- Key-Area Research and Development Program of Guangdong Province (2018B030339001)
- Fundamental Research Funds for the Central Universities (3332019015)
This publication has 47 references indexed in Scilit:
- Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCIIEEE Transactions on Biomedical Engineering, 2013
- Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interfaceJournal of Neural Engineering, 2013
- Event-related (De)synchronization (ERD/ERS) during motor imagery tasks: Implications for brain–computer interfacesInternational Journal of Industrial Ergonomics, 2011
- Asynchronous BCI control using high-frequency SSVEPJournal of NeuroEngineering and Rehabilitation, 2011
- Toward a hybrid brain–computer interface based on imagined movement and visual attentionJournal of Neural Engineering, 2010
- Improved signal processing approaches in an offline simulation of a hybrid brain–computer interfaceJournal of Neuroscience Methods, 2010
- The hybrid BCIFrontiers in Neuroscience, 2010
- A practical VEP-based brain-computer interfaceIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2006
- Brain–computer interfaces for communication and controlClinical Neurophysiology, 2002
- Visual evoked potentials: evidence for lateral interactions.Proceedings of the National Academy of Sciences, 1982