Data augmentation by separating identity and emotion representations for emotional gait recognition
- 6 February 2023
- journal article
- research article
- Published by Cambridge University Press (CUP) in Robotica
- Vol. 41 (5) , 1452-1465
Abstract
Human-centered intelligent human–robot interaction can transcend the traditional keyboard and mouse and have the capacity to understand human communicative intentions by actively mining implicit human clues (e.g., identity information and emotional information) to meet individuals’ needs. Gait is a unique biometric feature that can provide reliable information to recognize emotions even when viewed from a distance. However, the insufficient amount and diversity of training data annotated with emotions severely hinder the application of gait emotion recognition. In this paper, we propose an adversarial learning framework for emotional gait dataset augmentation, with which a two-stage model can be trained to generate a number of synthetic emotional samples by separating identity and emotion representations from gait trajectories. To our knowledge, this is the first work to realize the mutual transformation between natural gait and emotional gait. Experimental results reveal that the synthetic gait samples generated by the proposed networks are rich in emotional information. As a result, the emotion classifier trained on the augmented dataset is competitive with state-of-the-art gait emotion recognition works.Keywords
This publication has 31 references indexed in Scilit:
- CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Cross-Corpus Acoustic Emotion Recognition with Multi-Task Learning: Seeking Common Ground While Preserving DifferencesIEEE Transactions on Affective Computing, 2017
- Gait based recognition via fusing information from Euclidean and Riemannian manifoldsPattern Recognition Letters, 2016
- A gaze control of socially interactive robots in multiple-person interactionRobotica, 2016
- A framework for gait-based recognition using KinectPattern Recognition Letters, 2015
- FaceNet: A unified embedding for face recognition and clustering2015
- What Your Face Vlogs About: Expressions of Emotion and Big-Five Traits Impressions in YouTubeIEEE Transactions on Affective Computing, 2014
- Recognizing friends by their walk: Gait perception without familiarity cuesBulletin of the Psychonomic Society, 1977