Multi-Scale Mixed Dense Graph Convolution Network for Skeleton-Based Action Recognition
Open Access
- 4 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 36475-36484
Abstract
In skeleton-based action recognition, the approaches based on graph convolutional networks(GCN) have achieved remarkable performance by modeling spatial-temporal graphs to explore the physical dependencies between body joints. However, these methods mostly apply hierarchical GCNs to aggregate wider-range neighborhood information, which makes joint features be weakened during long diffusion. In this paper, we design a multi-scale mixed dense graph convolutional network (MMDGCN) to overcome both shortcomings. We propose a dense graph convolution operation to enhance the local context information of joints, and then the spatial and temporal attention modules with a larger receptive field are introduced to help the model strengthen the discriminative features to adaptively refine the intermediate feature maps. We also design a multi-scale mixed temporal convolution module, which provides a flexible temporal graph through the combination of different scale convolution kernels. Extensive experiments on the three real-world datasets (NTU-RGB+D, NTU-RGB+D120 and Kinetics) demonstrate that the performance of the proposed MMDGCN in skeleton-based action recognition.Keywords
Funding Information
- National Natural Science Foundation of China (61976022)
This publication has 22 references indexed in Scilit:
- Enhanced skeleton visualization for view invariant human action recognitionPattern Recognition, 2017
- Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields2017
- A New Representation of Skeleton Sequences for 3D Action Recognition2017
- Interpretable 3D Human Action Analysis with Temporal Convolutional Networks2017
- Spatio-Temporal LSTM with Trust Gates for 3D Human Action Recognition2016
- Modeling video evolution for action recognition2015
- Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group2014
- A “string of feature graphs” model for recognition of complex activities in natural videos2011
- Human activity analysisACM Computing Surveys, 2011
- Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interactionProceedings of the IEEE, 2002