Large-scale Isolated Gesture Recognition using Convolutional Neural Networks
Authors:
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7-12
Abstract
This paper proposes three simple, compact yet effective representations of depth sequences, referred to respectively as Dynamic Depth Images (DDI), Dynamic Depth Normal Images (DDNI) and Dynamic Depth Motion Normal Images (DDMNI). These dynamic images are constructed from a sequence of depth maps using bidirectional rank pooling to effectively capture the spatial-temporal information. Such image-based representations enable us to fine-tune the existing ConvNets models trained on image data for classification of depth sequences, without introducing large parameters to learn. Upon the proposed representations, a convolutional Neural networks (ConvNets) based method is developed for gesture recognition and evaluated on the Large-scale Isolated Gesture Recognition at the ChaLearn Looking at People (LAP) challenge 2016. The method achieved 55.57% classification accuracy and ranked 2 nd place in this challenge but was very close to the best performance even though we only used depth data.Keywords
This publication has 29 references indexed in Scilit:
- Explore Efficient Local Features from RGB-D Data for One-Shot Learning Gesture RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Action Recognition From Depth Maps Using Deep Convolutional Neural NetworksIEEE Transactions on Human-Machine Systems, 2015
- Long-term recurrent convolutional networks for visual recognition and description2015
- Beyond short snippets: Deep networks for video classification2015
- Caffe2014
- Mining Mid-Level Features for Action Recognition Based on Effective Skeleton Representation2014
- Range-Sample Depth Feature for Action Recognition2014
- The ChaLearn gesture dataset (CGD 2011)Machine Vision and Applications, 2014
- HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth Sequences2013
- A tutorial on support vector regressionStatistics and Computing, 2004