Linked motion image‐based dynamic hand gesture recognition
- 6 January 2023
- journal article
- research article
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 34 (6)
Abstract
The researchers have paid significant attention to dynamic images for hand gesture recognition. Dynamic images are gesture representation patterns that simultaneously capture spatial, temporal, and structural information from the video. Existing techniques to generate dynamic images provide low discriminability for the gestures, which follow the same trajectory, but in opposite directions, such as “swiping hand right” versus “swiping hand left.” Also, limited to similar gestures such as “Snap fingers” versus “Dual fingers heart.” To address these issues, we have proposed an algorithm to convert a depth video into a single dynamic image known as a linked motion image (LMI). We give the LMI to a classifier consisting of an ensemble of three modified pretrained convolutional neural networks. We conduct the experiments using a multimodal large‐scale EgoGesture dataset and The MSR Gesture 3D dataset. For the EgoGesture dataset, the proposed method achieved an accuracy of 92.91%, which is better than the state‐of‐the‐art methods. For the MSR Gesture 3D dataset, the proposed method accuracy is 100%, which outperforms the state‐of‐the‐art methods. This work also highlights the recognition accuracy and precision of each gesture. The experiments demonstrate the work's economic efficiency using a web‐based data science environment called Kaggle rather than high‐end systems like GPU.Keywords
This publication has 26 references indexed in Scilit:
- Large-scale Isolated Gesture Recognition using Convolutional Neural Networks2016
- Large-scale Continuous Gesture Recognition Using Convolutional Neural Networks2016
- Long-Term Recurrent Convolutional Networks for Visual Recognition and DescriptionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- Learning Spatiotemporal Features with 3D Convolutional Networks2015
- DMM-Pyramid Based Deep Architectures for Action Recognition with Depth Cameras2015
- Action Recognition from Depth Sequences Using Depth Motion Maps-Based Local Binary Patterns2015
- Caffe2014
- Gesture Recognition: A SurveyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2007
- Visual interpretation of hand gestures for human-computer interaction: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997