Deep Learning Models for Video-based Hand Gesture Recognition in Robotic Applications
Authors:
- 17 March 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 2168-2172
Abstract
Vision-based hand gestures recognition is often employed to remotely control machines and robots. In this work, we perform a comparison among multiple convolutional neural networks (CNNs) models, namely VGG16, InceptionNet, EfficientNet, and a self-designed CNN model for recognition of multiple hand gestures captured using a video camera. The video dataset has been self-collected for 24 dynamic hand gestures performed by 5 users. Key-frames are extracted from the input videos and processed in the considered CNN models for classification. The models are optimized for classification by varying the learning rates and the type of optimizer used during training. While VGG16, InceptionNet and the proposed CNN model attain the highest classification accuracy of 99.3055; the proposed CNN model consists of the least number of trainable paramters. Hence, the proposed CNN model is a light-weight model, which is suitable for deployment on edge device while it yields performance comparable with the well-known CNN models.Keywords
This publication has 15 references indexed in Scilit:
- Hand Gesture Recognition Based on Computer Vision: A Review of TechniquesJournal of Imaging, 2020
- Voice Assisted and Gesture Controlled Companion Robot2020
- Gesture and Speech Recognizing Helper BotApplied Artificial Intelligence, 2020
- Deep learning-based sign language recognition system for static signsNeural Computing and Applications, 2020
- Intuitive Bare-Hand Teleoperation of a Robotic Manipulator Using Virtual Reality and Leap Motion2019
- Hand Gesture-Based On-Line Programming of Industrial Robot Manipulators2019
- Research on image classification model based on deep convolution neural networkEURASIP Journal on Image and Video Processing, 2019
- A New Design Approach for Gesture Controlled Smart Wheelchair Utilizing Microcontroller2018
- Hand gesture recognition based on convolution neural networkCluster Computing, 2017
- ImageNet: A large-scale hierarchical image database2009