A Dataset with Bilingual TV Commands for Silent Speech Interfaces Using Electroencephalographic Signals

Authors:
Open Access
Publisher website
Google Scholar
Abstract
This paper introduces TESSCCo (TV-control EEG-based Silent Speech Command Corpus), a new dataset including electroencephalography (EEG) signals during Overt Speech (OS) and Covert Speech (CS) in different languages. The dataset comprises repetitions of five different commands pronounced covertly and overtly in English and Spanish from 21 healthy native Spanish speakers (13 male, 8 female, 23 ± 2 years old), while EEG and audio were recorded. In addition, 3 non-native healthy Spanish speakers were recorded under the same circumstances (3 male, 23.3 ± 0.6 years old). A total of 7936 available epochs (i.e., 11.02 hours of data) were recorded with a 32 channel, 256 Hz sampling rate Water based EEG device. The database was designed to maximize the number of different analysis involving EEG signals. The final number of epochs, as well as the statistical analysis (showing significance in Broca's and Wernicke's areas) and machine learning experiments (with subjects exceeding the chance level with basic machine learning models), show that this material is a valuable resource for research on future ways of communication.
Funding Information
  • Amazon (IPTC-Amazon collaboration (code 00600154-2023))
  • Universidad Politécnica de Madrid (Programa Propio I+D+i (no grant number available))
  • call for the implementation of programmes of R&D activities between research groups of the Community of Madrid in Biomedicine 2022 (MINA-CM programme (number S2022/BMD-7236))

This publication has 35 references indexed in Scilit: