Masaki Nakanishi

Visual stimuli design plays an important role in brain-computer interfaces (BCIs) based on visual evoked potentials (VEPs). Variations in stimulus parameters have been shown to affect both decoding accuracy and subjective perception experience, implying the need for a trade-off in design. In this study, we comprehensively and systematically compared various combinations of amplitude contrast and spectral content parameters in the stimulus design to quantify their impact on decoding performance and subject comfort. Specifically, three parameters were investigated: 1) contrast level, 2) temporal pattern (periodic steady-state or pseudo-random code-modulated), and 3) frequency range. We collected electroencephalogram (EEG) data and subjective perception ratings from ten subjects and evaluated the decoding accuracy and subject comfort rating for different combinations of the stimulus parameters. Our results indicate that while high-frequency steady-state VEP (SSVEP) stimuli were rated the most comfortable, they also had the lowest decoding accuracy. Conversely, low-frequency SSVEP stimuli were rated the least comfortable but had the highest decoding accuracy. Standard and high-frequency M-sequence code-modulated VEPs (c-VEPs) produced intermediates between the two. We observed a consistent trade-off relationship between decoding accuracy and subjective comfort level across all parameters. Based on our findings, we offer c-VEP as a preferable stimulus for achieving reliable decoding accuracy while maintaining a reasonable level of comfortability.

Afferent and efferent visual dysfunction are prominent features of multiple sclerosis (MS). Visual outcomes have been shown to be robust biomarkers of the overall disease state. Unfortunately, precise measurement of afferent and efferent function is typically limited to tertiary care facilities, which have the equipment and analytical capacity to make these measurements, and even then, only a few centers can accurately quantify both afferent and efferent dysfunction. These measurements are currently unavailable in acute care facilities (ER, hospital floors). We aimed to develop a moving multifocal steady-state visual evoked potential (mfSSVEP) stimulus to simultaneously assess afferent and efferent dysfunction in MS for application on a mobile platform. The brain-computer interface (BCI) platform consists of a head-mounted virtual-reality headset with electroencephalogram (EEG) and electrooculogram (EOG) sensors. To evaluate the platform, we recruited consecutive patients who met the 2017 MS McDonald diagnostic criteria and healthy controls for a pilot cross-sectional study. Nine MS patients (mean age 32.7 years, SD 4.33) and ten healthy controls (24.9 years, SD 7.2) completed the research protocol. The afferent measures based on mfSSVEPs showed a significant difference between the groups (signal-to-noise ratio of mfSSVEPs for controls: 2.50 ± 0.72 vs. MS: 2.04 ± 0.47) after controlling for age (p = 0.049). In addition, the moving stimulus successfully induced smooth pursuit movement that can be measured by the EOG signals. There was a trend for worse smooth pursuit tracking in cases vs. controls, but this did not reach nominal statistical significance in this small pilot sample. This study introduces a novel moving mfSSVEP stimulus for a BCI platform to evaluate neurologic visual function. The moving stimulus showed a reliable capability to assess both afferent and efferent visual functions simultaneously.

Objective: A user-friendly steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) prefers no calibration for its target recognition algorithm, however, the existing calibration-free schemes perform still far behind their calibration-based counterparts. To tackle this issue, learning online from the subject’s unlabeled data is investigated as a potential approach to boost the performance of the calibration-free SSVEP-based BCIs. Methods: An online adaptation scheme is developed to tune the spatial filters using the online unlabeled data from previous trials, and then developing the online adaptive canonical correlation analysis (OACCA) method. Results: A simulation study on two public SSVEP datasets (Dataset I and II) with a total of 105 subjects demonstrated that the proposed online adaptation scheme can boost the CCA’s averaged information transfer rate (ITR) from 94.60 to 158.87 bits/min in Dataset I and from 85.80 to 123.91 bits/min in Dataset II. Furthermore, in our online experiment it boosted the CCA’s ITR from 55.81 bits/min to 95.73 bits/min. More importantly, this online adaptation scheme can be easily combined with any spatial filtering-based algorithms to achieve online learning. Conclusion: By online adaptation, the proposed OACCA performed much better than the calibration-free CCA, and comparable to the calibration-based algorithms. Significance: This work provides a general way for the SSVEP-based BCIs to learn online from unlabeled data and thus avoid calibration.

This study presents a novel waveform-coding method for multi-target steady-state visual evoked potential (SSVEP)-based brain–computer interfaces (BCIs). Three periodic waveforms including square, sawtooth, and sinusoidal waves at various frequencies and initial phases were employed to elicit discriminable SSVEPs. A virtual keyboard was first designed using 36 visual stimuli modulated by the combinations of different frequencies, phases, and waveforms. With the virtual keyboard, 13 healthy participants performed offline and online BCI experiments with a cue-guided spelling task. The task-related component analysis (TRCA)-based algorithm was used to identify a target visual stimulus. The offline results showed that the visual stimuli tagged with different properties could accurately be identified by analyzing the elicited SSVEPs. Moreover, the online spelling task achieved promising performance with an averaged information transfer rate (ITR) of 62.6 ± 32.5 bits/min. This study validated the feasibility of implementing a multi-command SSVEP-based BCI using the hybrid waveform-, frequency- and phase-coding method. The proposed waveform-coding method provides a completely new channel for multi-target stimulus coding, expanding the research fields of an SSVEP-based BCI.

This commentary presents a replication study to verify the effectiveness of a sum of squared correlations (SSCOR)-based steady-state visual evoked potentials (SSVEPs) decoding method proposed by Kumar et al.. We implemented the SSCOR-based method in accordance with their descriptions and estimated its classification accuracy using a benchmark SSVEP dataset with cross validation. Our results showed significantly lower classification accuracy compared with the ones reported in Kumar et al.'s study. We further investigated the sources of performance discrepancy by simulating data leakage between training and test datasets. The classification performance of the simulation was remarkably similar to those reported by Kumar et al.. We, therefore, question the validity of evaluation and conclusions drawn in Kumar et al.'s study.

Objective. The emergence of mobile electroencephalogram (EEG) platforms have expanded the use cases of brain–computer interfaces (BCIs) from laboratory-oriented experiments to our daily life. In challenging situations where humans’ natural behaviors such as head movements are unrestrained, various artifacts could deteriorate the performance of BCI applications. This paper explored the effect of muscular artifacts generated by participants’ head movements on the signal characteristics and classification performance of steady-state visual evoked potentials (SSVEPs). Approach. A moving visual flicker was employed to induce not only SSVEPs but also horizontal and vertical head movements at controlled speeds, leading to acquiring EEG signals with intensity-manipulated muscular artifacts. To properly induce neck muscular activities, a laser light was attached to participants’ heads to give visual feedback; the laser light indicates the direction of the head independently from eye movements. The visual stimulus was also modulated by four distinct frequencies (10, 11, 12, and 13 Hz). The amplitude and signal-to-noise ratio (SNR) were estimated to quantify the effects of head movements on the signal characteristics of the elicited SSVEPs. The frequency identification accuracy was also estimated by using well-established decoding algorithms including calibration-free and fully-calibrated approaches. Main results. The amplitude and SNR of SSVEPs tended to deteriorate when the participants moved their heads, and this tendency was significantly stronger in the vertical head movements than in the horizontal movements. The frequency identification accuracy also deteriorated in proportion to the speed of head movements. Importantly, the accuracy was significantly higher than its chance-level regardless of the level of artifact contamination and algorithms. Significance. The results suggested the feasibility of decoding SSVEPs in humans freely moving their head directions, facilitating the real-world applications of mobile BCIs.

Objective: This paper proposes a novel device-to-device transfer-learning algorithm for reducing the calibration cost in a steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) speller by leveraging electroencephalographic (EEG) data previously acquired by different EEG systems. Methods: The transferring is done by projecting the scalp-channel EEG signals onto a shared latent domain across devices. Three spatial filtering techniques, including channel averaging, canonical correlation analysis (CCA), and task-related component analysis (TRCA), were employed to extract the shared responses from different devices. The transferred data were integrated into a template-matching-based algorithm to detect SSVEPs. To evaluate its transferability, this paper conducted two sessions of simulated online BCI experiments with ten subjects using 40 visual stimuli modulated by joint frequency-phase coding method. In each session, two different EEG devices were used: first, the Quick-30 system (Cognionics, Inc.) with dry electrodes, and second, the ActiveTwo system (BioSemi, Inc.) with wet electrodes. Results: The proposed method with CCA- and TRCA-based spatial filters achieved significantly higher classification accuracy compared with the calibration-free standard CCA-based method. Conclusion: This paper validated the feasibility and effectiveness of the proposed method in implementing calibration-free SSVEP-based BCIs. Significance: The proposed method has great potentials to enhance practicability and usability of real-world SSVEP-based BCI applications by leveraging user-specific data recorded in previous sessions even with different EEG systems and montages.

In the above paper [1] , a method has been proposed to use the correlated component analysis (CORCA) to learn spatial filters with multiple blocks of individual training data for steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) scenario. In order to evaluate the performance of CORCA, the task-related component analysis (TRCA)-based method was used as a baseline method [2] . For a fair and convincing comparison, the MATLAB codes on the website ( https://github.com/mnakanishi/TRCA-SSVEP ) for implementing TRCA method provided by Dr. Masaki Nakanishi, the first author of [2] , were used to take the role of the TRCA method. At that time, the proposed CORCA-based method outperforms the TRCA-based method [1] .