Bi-CapsNet: A Binary Capsule Network for EEG-Based Emotion Recognition
- 27 December 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (3) , 1319-1330
Abstract
In recent years, deep learning has gained widespread attention in electroencephalogram (EEG)-based emotion recognition. However, deep learning methods are usually time-consuming with a large amount of memory usage, which obstructs their practical usage on resource-constrained devices. In this paper, we propose a binary capsule network (Bi-CapsNet) for EEG emotion recognition with low computational cost and memory usage. The Bi-CapsNet binarizes 32-bit weights and activations to 1 bit, and replaces floating-point operations with efficient bitwise operations. To address the issue of function discontinuity in backward propagation, we use a continuous function to approximate the binarization process. Two popular EEG emotion databases, namely, DEAP and DREAMER, are used for performance evaluation. In comparison to its full-precision counterpart, the Bi-CapsNet achieves a $>25\times$ reduction on the computational cost and a $>5\times$ reduction on the memory usage, while with only a $< $ 1% drop on the recognition accuracy. Compared to some state-of-the-art EEG emotion recognition methods, the proposed method obtains more competitive performance. In addition, the Bi-CapsNet is implemented on a mobile phone via an open-source binary inference framework named Bolt, and it achieves an $\sim 5\times$ inference acceleration in comparison to its full-precision counterpart.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFA0706203)
- National Natural Science Foundation of China (62176081, 41901350, 32271431, 61922075, 62171176, 62271186)
- National Defense Basic Scientific Research Program of China (JCKY2019548B001, JZ2020HGPA0111, JZ2021HGTB0078, JZ2021HGPA0061)
- Fundamental Research Funds for the Central Universities
This publication has 52 references indexed in Scilit:
- Feature learning from incomplete EEG with denoising autoencoderNeurocomputing, 2015
- EmoNets: Multimodal deep learning approaches for emotion recognition in videoJournal on Multimodal User Interfaces, 2015
- Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural NetworksIEEE Transactions on Autonomous Mental Development, 2015
- Recognizing dynamic facial expressions of emotion: Specificity and intensity effects in event-related brain potentialsBiological Psychology, 2014
- Speeding up Convolutional Neural Networks with Low Rank Expansions2014
- Bi-modal emotion recognition from expressive face and body gesturesJournal of Network and Computer Applications, 2007
- What is a support vector machine?Nature Biotechnology, 2006
- Individual Comparisons by Ranking Methods1992
- Induction of decision treesMachine Learning, 1986
- EEG analysis based on time domain propertiesElectroencephalography and Clinical Neurophysiology, 1970