Abstract
In recent years, deep learning has gained widespread attention in electroencephalogram (EEG)-based emotion recognition. However, deep learning methods are usually time-consuming with a large amount of memory usage, which obstructs their practical usage on resource-constrained devices. In this paper, we propose a binary capsule network (Bi-CapsNet) for EEG emotion recognition with low computational cost and memory usage. The Bi-CapsNet binarizes 32-bit weights and activations to 1 bit, and replaces floating-point operations with efficient bitwise operations. To address the issue of function discontinuity in backward propagation, we use a continuous function to approximate the binarization process. Two popular EEG emotion databases, namely, DEAP and DREAMER, are used for performance evaluation. In comparison to its full-precision counterpart, the Bi-CapsNet achieves a $>25\times$ reduction on the computational cost and a $>5\times$ reduction on the memory usage, while with only a $< $ 1% drop on the recognition accuracy. Compared to some state-of-the-art EEG emotion recognition methods, the proposed method obtains more competitive performance. In addition, the Bi-CapsNet is implemented on a mobile phone via an open-source binary inference framework named Bolt, and it achieves an $\sim 5\times$ inference acceleration in comparison to its full-precision counterpart.
Funding Information
  • National Key Research and Development Program of China (2019YFA0706203)
  • National Natural Science Foundation of China (62176081, 41901350, 32271431, 61922075, 62171176, 62271186)
  • National Defense Basic Scientific Research Program of China (JCKY2019548B001, JZ2020HGPA0111, JZ2021HGTB0078, JZ2021HGPA0061)
  • Fundamental Research Funds for the Central Universities

This publication has 52 references indexed in Scilit: