Christian Breitwieser

In this paper, we present and analyze an event distribution system for brain-computer interfaces. Events are commonly used to mark and describe incidents during an experiment and are therefore critical for later data analysis or immediate real-time processing. The presented approach, called Tools for brain-computer interaction interface D (TiD), delivers messages in XML format via a buslike system using transmission control protocol connections or shared memory. A dedicated server dispatches TiD messages to distributed or local clients. The TiD message is designed to be flexible and contains time stamps for event synchronization, whereas events describe incidents, which occur during an experiment. TiD was tested extensively toward stability and latency. The effect of an occurring event jitter was analyzed and benchmarked on a reference implementation under different conditions as gigabit and 100-Mb Ethernet or Wi-Fi with a different number of event receivers. A 3-dB signal attenuation, which occurs when averaging jitter influenced trials aligned by events, is starting to become visible at around 1-2 kHz in the case of a gigabit connection. Mean event distribution times across operating systems are ranging from 0.3 to 0.5ms for a gigabit network connection for 10 ⁶ events. Results for other environmental conditions are available in this paper. References already using TiD for event distribution are provided showing the applicability of TiD for event delivery with distributed or local clients.

Objective. This paper investigates the fusion of steady-state somatosensory evoked potentials (SSSEPs) and transient event-related potentials (tERPs), evoked through tactile simulation on the left and right-hand fingertips, in a three-class EEG based hybrid brain–computer interface. It was hypothesized, that fusing the input signals leads to higher classification rates than classifying tERP and SSSEP individually. Approach. Fourteen subjects participated in the studies, consisting of a screening paradigm to determine person dependent resonance-like frequencies and a subsequent online paradigm. The whole setup of the BCI system was based on open interfaces, following suggestions for a common implementation platform. During the online experiment, subjects were instructed to focus their attention on the stimulated fingertips as indicated by a visual cue. The recorded data were classified during runtime using a multi-class shrinkage LDA classifier and the outputs were fused together applying a posterior probability based fusion. Data were further analyzed offline, involving a combined classification of SSSEP and tERP features as a second fusion principle. The final results were tested for statistical significance applying a repeated measures ANOVA. Main results. A significant classification increase was achieved when fusing the results with a combined classification compared to performing an individual classification. Furthermore, the SSSEP classifier was significantly better in detecting a non-control state, whereas the tERP classifier was significantly better in detecting control states. Subjects who had a higher relative band power increase during the screening session also achieved significantly higher classification results than subjects with lower relative band power increase. Significance. It could be shown that utilizing SSSEP and tERP for hBCIs increases the classification accuracy and also that tERP and SSSEP are not classifying control- and non-control states with the same level of accuracy.

In earlier literature, so-called twitches were used to support a user in a steady-state somatosensory evoked potential (SSSEP) based brain-computer interface (BCI) to focus attention on the requested targets. Within this work, we investigate the impact of these transient target stimuli on SSSEPs in a real-life BCI setup. A hybrid BCI was designed which combines SSSEPs and P300 potentials evoked by twitches randomly embedded into the streams of tactile stimuli. The EEG of fourteen healthy subjects was recorded, while their left and right index fingers were simultaneously stimulated using frequencies selected in a screening procedure. The subjects were randomly instructed by a cue on a screen to focus attention on one or none of the fingers. Feature for SSSEPs and P300 potentials were extracted and classified using separately trained multi-class shrinkage LDA classifiers. Three-class classification accuracies significantly better than random could be reached by nine subjects using SSSEP features and by twelve subjects using P300 features respectively. The average classification accuracies were 48.6% using SSSEP and 50.7% using P300 features. By means of a Monte Carlo permutation test it could be shown that twitches have an attenuation effect on the SSSEP. Significant SSSEP blocking effects time-locked to twitch positions were found in seven subjects. Our findings suggest that the attempt to combine different types of stimulation signals like repetitive signals and twitches has a mutual influence on each other, which may be the main reason for the rather moderate BCI performance. This influence is originated at the level of stimulus generation but becomes apparent as physiological effect in the SSSEP. When designing a hybrid BCI based on SSSEPs and P300 potentials, one has to find an optimal tradeoff depending on the overall design goals or individual subjects' performance. Our results give therefore some new insights that may be useful for the successful design of hybrid BCIs.

This document contains the documentation of TOBI (Tools for BCI) Interface D (TiD). TiD tries to establish a standardized interface for event transmission in neuroscience experiments. It is designed in a client-server architecture. Clients are connecting to a single server and events are delivered in a "bus-like" manner. TiD events are based on XML messages. So TiD messages can also get custom extended. A cross platform C++ library is available and provides all TiD functionality. To avoid jitter effect, hampering event processing, TiD was optimized towards performance. The documentation provides further performance tweaks to decrease TiD message processing latency and also decrease event timing jitter.

Steady-state somatosensory evoked potentials (SSSEPs) have been elicited applying vibro-tactile stimulation to all fingertips of the right hand. Nine healthy subjects participated in two sessions within this study. All fingers were stimulated 40 times with a 200-Hz carrier frequency modulated with a rectangular signal. The frequencies of the rectangular signal ranged between 17 and 35 Hz in 2 Hz steps. Relative band power tuning curves were calculated, introducing two different methods. Person-specific resonance-like frequencies were selected based on the data from the first session. The selected resonance-like frequencies were compared with the second session using an ANOVA for repeated measures to investigate the stability of SSSEPs over time. To determine, if SSSEPs can be classified with a classifier based on unseen data, an LDA classifier was trained with data from the first and applied to data from the second session. Person-specific resonance-like frequencies within a range from 19 to 29 Hz were found. The relative band power of the resonance-like frequencies did not differ significantly between the two sessions. Significant differences were found for the two methods and the used channels. SSSEPs were classified with a hit rate from 51 to 96 %.

In this paper, we propose a standardized interface called TiA (TOBI interface A) to transmit raw biosignals, supporting multirate and block-oriented transmission of different kinds of signals from various acquisition devices (e.g., EEG, electrooculogram, near-infrared spectroscopy signals, etc.) at the same time. To facilitate a distinction between those kinds of signals, so-called signal types are introduced. TiA is a single-server, multiple-client system, whereby clients can connect to the server at runtime. Information transfer between client and server is divided into control and data connections. The control connections use transmission control protocol (TCP) and transmit extensible-markup-language (XML)-encoded meta information. The data transmission utilizes a user datagram protocol (UDP) or TCP with a binary data stream. A standardized handshaking procedure for the connection setup and a standardized binary data packet has been defined. Thus, a standardized layer, abstracting used hardware devices and facilitating distributed raw data transmission in a standardized way, has been evolved. A cross-platform library, implemented in C++, is available for download.

With this concept we introduced the attempt of a standardized interface called TiA to transmit raw biosignals. TiA is able to deal with multirate and block-oriented data transmission. Data is distinguished by different signal types (e.g., EEG, EOG, NIRS, ...), whereby those signals can be acquired at the same time from different acquisition devices. TiA is built as a client-server model. Multiple clients can connect to one server. Information is exchanged via a control- and a separated data connection. Control commands and meta information are transmitted over the control connection. Raw biosignal data is delivered using the data connection in a unidirectional way. For this purpose a standardized handshaking protocol and raw data packet have been developed. Thus, an abstraction layer between hardware devices and data processing was evolved facilitating standardization.