Enhanced dynamic hand gesture recognition for finger disabilities using deep learning and an optimized Otsu threshold method
- 21 January 2025
- journal article
- research article
- Published by IOP Publishing in Engineering Research Express
- Vol. 7 (1) , 015228
Abstract
Hand gestures serve as a powerful means of communication, capable of conveying extensive information across various public health domains, including medicine and education. The process of hand gesture recognition involves the use of mathematical algorithms to identify human gestures and finds applications in areas such as communication for the deaf, human-computer interaction, intelligent driving, and virtual reality. This study introduces a robust method aimed at recognizing dynamic hand gestures, particularly for individuals with finger disabilities. The approach begins with segmenting hand gestures from intricate backgrounds using an advanced Otsu segmentation algorithm, while also integrating motion data from RGB video sequences. Hand gestures are transformed into texture and contour features, which are utilized as input for a hybrid model that merges a convolutional neural network (CNN) with a recurrent neural network (RNN). The model employs Inception-v3 for feature extraction complemented by an LSTM layer for classification. The focus of the study is on recognizing six dynamic gestures, with particular emphasis on ‘scroll right’ and ‘scroll down’ due to their high accuracy in recognition. The model demonstrated an average precision of 84.34% across all gestures, achieving 87.57% for gestures involving finger impairments. These results highlight the model’s effectiveness in practical applications for dynamic hand gesture recognition.Keywords
This publication has 40 references indexed in Scilit:
- Real-time continuous detection and recognition of dynamic hand gestures in untrimmed sequences based on end-to-end architecture with 3D DenseNet and LSTMMultimedia Tools and Applications, 2023
- Attention-based hand semantic segmentation and gesture recognition using deep networksEvolving Systems, 2023
- An Exploration into Human–Computer Interaction: Hand Gesture Recognition Management in a Challenging EnvironmentSN Computer Science, 2023
- Thermal image-based hand gesture recognition for worker-robot collaboration in the construction industry: A feasible studyAdvanced Engineering Informatics, 2023
- Comparison between handcraft feature extraction and methods based on Recurrent Neural Network models for gesture recognition by instrumented gloves: A case for Brazilian Sign Language AlphabetBiomedical Signal Processing and Control, 2022
- Depth camera based dataset of hand gesturesData in Brief, 2022
- Surface Electromyography Signal Recognition Based on Deep Learning for Human-Robot Interaction and CollaborationJournal of Intelligent & Robotic Systems, 2022
- Performance analysis of static hand gesture recognition approaches using artificial neural network, support vector machine and two stream based transfer learning approachInternational Journal of Information Technology, 2021
- Comparison of RGB-D and IMU-based gesture recognition for human-robot interaction in remanufacturingThe International Journal of Advanced Manufacturing Technology, 2021
- Sequentially Supervised Long Short-Term Memory for Gesture RecognitionCognitive Computation, 2016