Hierarchical Channel-aware Optimization Graph Convolution with Contrastive Learning for Emotion Recognition from Body Motion
- 5 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. PP (3) , 1-15
Abstract
Graph Convolutional Networks (GCNs) have shown strong potential in skeleton-based emotion recognition. However, existing methods often struggle to capture fine-grained details of key body parts. A Hierarchical Channel-Aware Optimization Graph Convolutional Network (HCO-GCN) is proposed. This framework enhances emotion recognition by integrating hierarchical graph decomposition to capture multi-scale dependencies, and the channel-aware optimization mechanism dynamically learns emotion-discriminative spatial patterns through channel wise computations, focusing on fine-grained motion details of critical body joints. To further enhance the representations learned by HCO-GCN, we introduce a multi-stage, multi-level contrastive learning (MMCL) framework. This design encourages more discriminative feature and graph representations across network stages, promoting improved intra-class consistency and inter-class separability. Furthermore, we propose a multi-task learning strategy within a primary–auxiliary task framework, where prior affective knowledge is integrated into the network through affective feature prediction, emotion classification, and contrastive learning, thereby boosting generalization. Experimental results on two public and one private datasets demonstrate the effectiveness of the proposed method in enhancing emotion recognition performance.Keywords
Funding Information
- National Natural Science Foundation of China (62373073)
- Fundamental Research Funds for the Central Universities (DUT25YG111)
This publication has 44 references indexed in Scilit:
- G-GCSN: Global Graph Convolution Shrinkage Network for Emotion Perception from Gait2021
- Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping2020
- The role of computational and subjective features in emotional body expressionsScientific Reports, 2020
- Deep High-Resolution Representation Learning for Human Pose Estimation2019
- Not all is noticed: Kinematic cues of emotion-specific gaitHuman Movement Science, 2018
- Effort-Shape and kinematic assessment of bodily expression of emotion during gaitHuman Movement Science, 2012
- Emotion expression in body action and posture.Emotion, 2012
- Methodology for Assessing Bodily Expression of EmotionJournal of Nonverbal Behavior, 2010
- Embodiment of Sadness and Depression—Gait Patterns Associated With Dysphoric MoodPsychosomatic Medicine, 2009
- Bodily expression of emotionEuropean Journal of Social Psychology, 1998