Imagined speech can be decoded from low- and cross-frequency intracranial EEG features
Top Cited Papers
Open Access
- 10 January 2022
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 13 (1) , 1-14
Abstract
Reconstructing intended speech from neural activity using brain-computer interfaces holds great promises for people with severe speech production deficits. While decoding overt speech has progressed, decoding imagined speech has met limited success, mainly because the associated neural signals are weak and variable compared to overt speech, hence difficult to decode by learning algorithms. We obtained three electrocorticography datasets from 13 patients, with electrodes implanted for epilepsy evaluation, who performed overt and imagined speech production tasks. Based on recent theories of speech neural processing, we extracted consistent and specific neural features usable for future brain computer interfaces, and assessed their performance to discriminate speech items in articulatory, phonetic, and vocalic representation spaces. While high-frequency activity provided the best signal for overt speech, both low- and higher-frequency power and local cross-frequency contributed to imagined speech decoding, in particular in phonetic and vocalic, i.e. perceptual, spaces. These findings show that low-frequency power and cross-frequency dynamics contain key information for imagined speech decoding.Keywords
This publication has 74 references indexed in Scilit:
- FreeSurferNeuroImage, 2012
- Reach and grasp by people with tetraplegia using a neurally controlled robotic armNature, 2012
- The neural correlates of inner speech defined by voxel-based lesion-symptom mappingBrain, 2011
- Different Origins of Gamma Rhythm and High-Gamma Activity in Macaque Visual CortexPLOS Biology, 2011
- A global averaging method for dynamic time warping, with applications to clusteringPattern Recognition, 2011
- Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetitionNeuroImage, 2011
- Measuring Phase-Amplitude Coupling Between Neuronal Oscillations of Different FrequenciesJournal of Neurophysiology, 2010
- Cortical activity during motor execution, motor imagery, and imagery-based online feedbackProceedings of the National Academy of Sciences, 2010
- Mental imagery of speech and movement implicates the dynamics of internal forward modelsFrontiers in Psychology, 2010
- A Wireless Brain-Machine Interface for Real-Time Speech SynthesisPLOS ONE, 2009