Auditory Perception as a Surrogate for Auditory Imagery in EEG-Based BCI Training: Neural Evidence and a Feasibility Study
Open Access
- 15 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 34 (15344320) , 3041-3052
Abstract
Brain-computer interface (BCI) systems are commonly classified as reactive or active. Reactive BCIs rely on responses to external stimuli, simplifying decoding but limiting direct user control. In contrast, active BCIs enable intuitive control through spontaneous mental activity but impose greater signal-processing challenges. Speech BCIs, a subset of active systems, hold promise for individuals with severe neurological impairments such as locked-in syndrome (LIS), potentially enabling communication through imagined speech. However, their adoption is hindered by the demanding pre-training required to collect imagery data, which often induces fatigue, and the difficulty many users face in generating consistent, high-quality imagery. To address these limitations, we propose a hybrid BCI framework that uses passive listening tasks as a surrogate for auditory imagery tasks during model training. As a first step, this proof-of-concept feasibility study examined neural responses to five Japanese vowels (/a/, /i/, /u/, /e/, /o/) under listening and imagery conditions in a limited experimental setting with healthy male participants, using event-related potentials (ERPs), topographical mapping, and event-related spectral perturbations (ERSPs), followed by statistical analysis of shared and distinct neural patterns. In the primary three-class and binary classification analyses, classification accuracies for imagery signals obtained from models trained solely on listening data were comparable to, and in some settings higher than, those trained directly on imagery data, with both outperforming chance level. These findings indicate that passive listening may provide effective training data for active auditory imagery BCIs within the tested setting, potentially reducing cognitive demands without compromising performance. Further validation in larger and more diverse cohorts is required before clinical application.Keywords
Funding Information
- Japan Science and Technology Agency (JST) BOOST program (Broadening Opportunities for Outstanding young researchers and doctoral students in STrategic areas), Japan (JPMJBS2430)
- JST Support for Pioneering Research Initiated by the Next Generation (SPRING), Japan (JPMJSP2106)
- JST Support for Pioneering Research Initiated by the Next Generation (SPRING), Japan (JPMJSP2180)
This publication has 46 references indexed in Scilit:
- The evolving roles and impacts of 5G enabled technologies in healthcare: The world epidemic COVID-19 issuesArray, 2022
- Keeping the inner voice inside the head, a pilot fMRI studyBrain and Behavior, 2021
- Vowel Sound Synthesis from Electroencephalography during Listening and RecallingAdvanced Intelligent Systems, 2021
- Speaking-Induced Suppression of the Auditory Cortex in Humans and Its Relevance to SchizophreniaBiological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2019
- Phonetic detail and lateralization of reading‐related inner speech and of auditory and somatosensory feedback processing during overt readingHuman Brain Mapping, 2016
- Classification of silent speech using support vector machine and relevance vector machineApplied Soft Computing, 2014
- Analysis and classification of speech imagery EEG for BCIBiomedical Signal Processing and Control, 2013
- Affective ERP processing in a visual oddball task: Arousal, valence, and genderClinical Neurophysiology, 2008
- Restating the importance of bipolar recording in subcortical nucleiClinical Neurophysiology, 2006
- Speech dominance and handedness in the normal humanBrain and Language, 1978