Deep Learning on Lie Groups for Skeleton-Based Action Recognition
Authors:
- Zhiwu HuangZHZhiwu Huang
- Chengde WanCWChengde Wan
- Thomas ProbstTPThomas Probst
- Luc Van GoolLGLuc Van Gool
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1243-1252
Abstract
In recent years, skeleton-based action recognition has become a popular 3D classification problem. State-of-the-art methods typically first represent each motion sequence as a high-dimensional trajectory on a Lie group with an additional dynamic time warping, and then shallowly learn favorable Lie group features. In this paper we incorporate the Lie group structure into a deep network architecture to learn more appropriate Lie group features for 3D action recognition. Within the network structure, we design rotation mapping layers to transform the input Lie group features into desirable ones, which are aligned better in the temporal domain. To reduce the high feature dimensionality, the architecture is equipped with rotation pooling layers for the elements on the Lie group. Furthermore, we propose a logarithm mapping layer to map the resulting manifold data into a tangent space that facilitates the application of regular output layers for the final classification. Evaluations of the proposed network for standard 3D human action recognition datasets clearly demonstrate its superiority over existing shallow Lie group feature learning methods as well as most conventional deep learning methods.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Learning class‐specific descriptors for deformable shapes using localized spectral convolutional networksComputer Graphics Forum, 2015
- A discrete regression method on manifolds and its application to data on SO(n)IFAC Proceedings Volumes, 2011
- On the Geometry of Rolling and Interpolation Curves on S n , SO n , and Grassmann ManifoldsJournal of Dynamical and Control Systems, 2007
- Laplacian Eigenmaps for Dimensionality Reduction and Data RepresentationNeural Computation, 2003
- Hessian eigenmaps: Locally linear embedding techniques for high-dimensional dataProceedings of the National Academy of Sciences, 2003
- UNSUPERVISED NEURAL LEARNING ON LIE GROUPInternational Journal of Neural Systems, 2002
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Hopfield networks and symmetry groupsNeurocomputing, 1995
- Changing Network Weights by Lie Groups1995