4-Class MI-EEG Signal Generation and Recognition with CVAE-GAN
Open Access
- 18 February 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (4) , 1798
Abstract
As the capability of an electroencephalogram’s (EEG) measurement of the real-time electrodynamics of the human brain is known to all, signal processing techniques, particularly deep learning, could either provide a novel solution for learning but also optimize robust representations from EEG signals. Considering the limited data collection and inadequate concentration of during subjects testing, it becomes essential to obtain sufficient training data and useful features with a potential end-user of a brain–computer interface (BCI) system. In this paper, we combined a conditional variational auto-encoder network (CVAE) with a generative adversarial network (GAN) for learning latent representations from EEG brain signals. By updating the fine-tuned parameter fed into the resulting generative model, we could synthetize the EEG signal under a specific category. We employed an encoder network to obtain the distributed samples of the EEG signal, and applied an adversarial learning mechanism to continuous optimization of the parameters of the generator, discriminator and classifier. The CVAE was adopted to adjust the synthetics more approximately to the real sample class. Finally, we demonstrated our approach take advantages of both statistic and feature matching to make the training process converge faster and more stable and address the problem of small-scale datasets in deep learning applications for motor imagery tasks through data augmentation. The augmented training datasets produced by our proposed CVAE-GAN method significantly enhance the performance of MI-EEG recognition.Keywords
Funding Information
- Introduction of Talent Research Startup Fund Project of Kunming University of Science and Technology under Program (KKSY201903028)
- National Natural Science Foundation of China (31760281)
This publication has 18 references indexed in Scilit:
- Information Generative Bayesian Adversarial Networks: A Representation Learning Model for Transmission Gear ParametersIEEE/ASME Transactions on Mechatronics, 2019
- Deep learning-based electroencephalography analysis: a systematic reviewJournal of Neural Engineering, 2019
- A Novel and Efficient CVAE-GAN-Based Approach With Informative Manifold for Semi-Supervised Anomaly DetectionIEEE Access, 2019
- Transfer Learning in Brain-Computer Interfaces with Adversarial Variational Autoencoders2019
- ElectroencephalographyCurrent Biology, 2019
- CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training2017
- Autoreject: Automated artifact rejection for MEG and EEG dataNeuroImage, 2017
- The PREP pipeline: standardized preprocessing for large-scale EEG analysisFrontiers in Neuroinformatics, 2015
- Mixtures of Conditional Gaussian Scale Mixtures Applied to Multiscale Image RepresentationsPLOS ONE, 2012
- Classification of Periodic Activities Using the Wasserstein DistanceIEEE Transactions on Biomedical Engineering, 2012