InfoGCN: Representation Learning for Human Skeleton-based Action Recognition
Authors:
Top Cited Papers
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 20154-20164
Abstract
Human skeleton-based action recognition offers a valuable means to understand the intricacies of human behavior because it can handle the complex relationships between physical constraints and intention. Although several studies have focused on encoding a skeleton, less attention has been paid to embed this information into the latent representations of human action. InfoGCN proposes a learning framework for action recognition combining a novel learning objective and an encoding method. First, we design an information bottleneck-based learning objective to guide the model to learn informative but compact latent representations. To provide discriminative information for classifying action, we introduce attention-based graph convolution that captures the context-dependent intrinsic topology of human action. In addition, we present a multi-modal representation of the skeleton using the relative position of joints, designed to provide complementary spatial information for joints. InfoGcn 1 1 Code is available at github.com/stnoahl/infogcn surpasses the known state-of-the-art on multiple skeleton-based action recognition benchmarks with the accuracy of 93.0% on NTU RGB+D 60 cross-subject split, 89.8% on NTU RGB+D 120 cross-subject split, and 97.0% on NW-UCLA.Keywords
This publication has 37 references indexed in Scilit:
- RNN Fisher Vectors for Action Recognition and Image Annotation2016
- NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis2016
- Deep Residual Learning for Image Recognition2016
- Rethinking the Inception Architecture for Computer Vision2016
- Differential Recurrent Neural Networks for Action Recognition2015
- P-CNN: Pose-Based CNN Features for Action Recognition2015
- Cross-View Action Modeling, Learning, and Recognition2014
- Learning Actionlet Ensemble for 3D Human Action RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Visual Navigation for Mobile Robots: A SurveyJournal of Intelligent & Robotic Systems, 2008