Towards decoding speech production from single-trial magnetoencephalography (MEG) signals
Authors:
- 1 March 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3036-3040
Abstract
Patients with locked-in-syndrome (fully paralyzed but aware) struggle in their life and communication. Providing a level of communication offers these patients a chance to resume a meaningful life. Current brain-computer interface (BCI) communication requires users to build words from single letters selected on a screen, which is extremely inefficient. Faster approaches for their speech communication are highly needed. This project investigated the possibility to decode spoken phrases from non-invasive brain activity (MEG) signals. This direct brain-to-text mapping approach may provide a significantly faster communication rate than current BCIs can provide. We used dynamic time warping and Wiener filtering for noise reduction and then Gaussian mixture model and artificial neural network as the decoders. Preliminary results showed the possibility of decoding speech production from non-invasive brain signals. The best phrase classification accuracy was up to 94.54% from single-trial whole-head MEG recordings.Keywords
This publication has 23 references indexed in Scilit:
- The prevalence and characteristics of patients with classic locked-in syndrome in Dutch nursing homesJournal of Neurology, 2013
- MEG studies of motor cortex gamma oscillations: evidence for a gamma “fingerprint” in the brain?Frontiers in Human Neuroscience, 2013
- Decoding word and category-specific spatiotemporal representations from MEG and EEGNeuroImage, 2011
- Electroencephalographic (EEG) control of three-dimensional movementJournal of Neural Engineering, 2010
- Brain–computer interfaces for speech communicationSpeech Communication, 2010
- A P300-based brain–computer interface for people with amyotrophic lateral sclerosisClinical Neurophysiology, 2008
- Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic StrokeStroke, 2008
- Brain–computer interfaces: communication and restoration of movement in paralysisThe Journal of Physiology, 2007
- Brain–computer-interface research: Coming of ageClinical Neurophysiology, 2006
- Brain–computer interfaces for communication and controlClinical Neurophysiology, 2002