Wenhao Chu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Wenhao Chu has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Baole Fu
Institute for Future, School of Automation, Qingdao University, Qingdao, China
2 shared publications - Yinhua Liu
School of Automation, Qingdao University, Qingdao 266071, China
2 shared publications - Chunrui Gu
Institute for Future, Qingdao University, Qingdao, China
1 shared publication Yuxiao Xia
School of Automation, Qingdao University, Qingdao, China
1 shared publication
Latest Publications
- 25 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (10) , 5865-5876
Cross-Modal Guiding Neural Network for Multimodal Emotion Recognition From EEG and Eye Movement Signals
Multimodal emotion recognition research is gaining attention because of the emerging trend of integrating information from different sensory modalities to improve performance. Electroencephalogram (EEG) signals are considered objective indicators of emotions and provide precise insights despite their complex data collection. In contrast, eye movement signals are more susceptible to environmental and individual differences but offer convenient data collection. Conventional emotion recognition methods typically use separate models for different modalities, potentially overlooking their inherent connections. This study introduces a cross-modal guiding neural network designed to fully leverage the strengths of both modalities. The network includes a dual-branch feature extraction module that simultaneously extracts features from EEG and eye movement signals. In addition, the network includes a feature guidance module that uses EEG features to direct eye movement feature extraction, reducing the impact of subjective factors. This study also introduces a feature reweighting module to explore emotion-related features within eye movement signals, thereby improving emotion classification accuracy. The empirical findings from both the SEED-IV dataset and our collected dataset substantiate the commendable performance of the model, thereby confirming its efficacy.
- 25 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (10) , 5865-5876
Cross-Modal Guiding Neural Network for Multimodal Emotion Recognition From EEG and Eye Movement Signals
Multimodal emotion recognition research is gaining attention because of the emerging trend of integrating information from different sensory modalities to improve performance. Electroencephalogram (EEG) signals are considered objective indicators of emotions and provide precise insights despite their complex data collection. In contrast, eye movement signals are more susceptible to environmental and individual differences but offer convenient data collection. Conventional emotion recognition methods typically use separate models for different modalities, potentially overlooking their inherent connections. This study introduces a cross-modal guiding neural network designed to fully leverage the strengths of both modalities. The network includes a dual-branch feature extraction module that simultaneously extracts features from EEG and eye movement signals. In addition, the network includes a feature guidance module that uses EEG features to direct eye movement feature extraction, reducing the impact of subjective factors. This study also introduces a feature reweighting module to explore emotion-related features within eye movement signals, thereby improving emotion classification accuracy. The empirical findings from both the SEED-IV dataset and our collected dataset substantiate the commendable performance of the model, thereby confirming its efficacy.
- Open Access
- 25 August 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 92496-92504
EEG-Based Emotion Recognition Using Spatial-Temporal Connectivity
The connectivity properties between EEG signaling channels were found to play an important role in emotion recognition. During the generation and change of emotions, the connectivity between EEG signal channels is not only manifested in the spatial domain at a specific time, but also interconnected between different time intervals, which is often overlooked. A novel approach is proposed to exploit the shapes of spatial-temporal connectivity for EEG-based emotion recognition. By quantifying the connectivity strength of EEG signal channels within and across time intervals, spatial-temporal connectivity features are extracted, and these features can be represented by shapes in the three-dimensional space of EEG signals. Through these shapes, a mapping of different emotional states and brain activity is constructed. Subsequently, a parallel multi-scale convolutional neural network is employed to extract discriminative features from these connectivity shapes, facilitating the classification and identification of emotional states. Experimental results on the DEAP dataset show that our method achieves excellent performance, with an average classification accuracy of 93.25 % and 93.16 % for the two emotion dimensions of valence and arousal, respectively.
- 25 August 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 92496-92504
Open AccessEEG-Based Emotion Recognition Using Spatial-Temporal Connectivity
The connectivity properties between EEG signaling channels were found to play an important role in emotion recognition. During the generation and change of emotions, the connectivity between EEG signal channels is not only manifested in the spatial domain at a specific time, but also interconnected between different time intervals, which is often overlooked. A novel approach is proposed to exploit the shapes of spatial-temporal connectivity for EEG-based emotion recognition. By quantifying the connectivity strength of EEG signal channels within and across time intervals, spatial-temporal connectivity features are extracted, and these features can be represented by shapes in the three-dimensional space of EEG signals. Through these shapes, a mapping of different emotional states and brain activity is constructed. Subsequently, a parallel multi-scale convolutional neural network is employed to extract discriminative features from these connectivity shapes, facilitating the classification and identification of emotional states. Experimental results on the DEAP dataset show that our method achieves excellent performance, with an average classification accuracy of 93.25 % and 93.16 % for the two emotion dimensions of valence and arousal, respectively.