Does bimodal stimulus presentation increase ERP components usable in BCIs?
Authors:
- Marieke E ThurlingsMTMarieke E Thurlings
- Anne-Marie BrouwerABAnne-Marie Brouwer
- Jan B F Van ErpJEJan B F Van Erp
- Benjamin BlankertzBBBenjamin Blankertz
- Peter J WerkhovenPWPeter J Werkhoven
- 25 July 2012
- journal article
- research article
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 9 (4) , 045005
Abstract
Event-related potential (ERP)-based brain-computer interfaces (BCIs) employ differences in brain responses to attended and ignored stimuli. Typically, visual stimuli are used. Tactile stimuli have recently been suggested as a gaze-independent alternative. Bimodal stimuli could evoke additional brain activity due to multisensory integration which may be of use in BCIs. We investigated the effect of visual-tactile stimulus presentation on the chain of ERP components, BCI performance (classification accuracies and bitrates) and participants' task performance (counting of targets). Ten participants were instructed to navigate a visual display by attending (spatially) to targets in sequences of either visual, tactile or visual-tactile stimuli. We observe that attending to visual-tactile (compared to either visual or tactile) stimuli results in an enhanced early ERP component (N1). This bimodal N1 may enhance BCI performance, as suggested by a nonsignificant positive trend in offline classification accuracies. A late ERP component (P300) is reduced when attending to visual-tactile compared to visual stimuli, which is consistent with the nonsignificant negative trend of participants' task performance. We discuss these findings in the light of affected spatial attention at high-level compared to low-level stimulus processing. Furthermore, we evaluate bimodal BCIs from a practical perspective and for future applications.Keywords
This publication has 52 references indexed in Scilit:
- Single-trial analysis and classification of ERP components — A tutorialNeuroImage, 2011
- P300 audio-visual spellerJournal of Neural Engineering, 2011
- Does the ‘P300’ speller depend on eye gaze?Journal of Neural Engineering, 2010
- Which Physiological Components are More Suitable for Visual ERP Based Brain–Computer Interface? A Preliminary MEG/EEG StudyBrain Topography, 2010
- Covert attention allows for continuous control of brain–computer interfacesEuropean Journal of Neuroscience, 2010
- Toward a hybrid brain–computer interface based on imagined movement and visual attentionJournal of Neural Engineering, 2010
- Towards an independent brain–computer interface using steady state visual evoked potentialsClinical Neurophysiology, 2008
- Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and JudgmentsNeuron, 2008
- Merging the senses into a robust perceptTrends in Cognitive Sciences, 2004
- Electrophysiological Studies of Human Face Perception. I: Potentials Generated in Occipitotemporal Cortex by Face and Non-face StimuliCerebral Cortex, 1999