DEEP AND MACHINE LEARNING MODELS FOR RECOGNIZING STATIC AND DYNAMIC GESTURES OF THE KAZAKH ALPHABET
Open Access
- 30 June 2024
- journal article
- research article
- Published by Astana IT University in Scientific Journal of Astana IT University
- p. 75-95
Abstract
Currently, an increasing amount of research is directed towards solving tasks using computer vision libraries and artificial intelligence tools. Most common are the solutions and approaches utilizing machine and deep learning models of artificial neural networks for recognizing gestures of the Kazakh sign language based on supervised learning methods and deep learning for processing sequential data. The research object is the Kazakh sign language alphabet aimed at facilitating communication for individuals with limited abilities. The research subject comprises machine learning methods and models of artificial neural networks and deep learning for gesture classification and recognition. The research areas encompass Machine Learning, Deep Learning, Neural Networks, and Computer Vision. The main challenge lies in recognizing dynamic hand gestures. In the Kazakh sign language alphabet, there are 42 letters, with 12 of them being dynamic. Processing, capturing, and recognizing gestures in motion, particularly in dynamics, pose a highly complex task. It is imperative to employ modern technologies and unconventional approaches by combining various recognition methods/algorithms to develop and construct a hybrid neural network model for gesture recognition. Gesture recognition is a classification task, which is one of the directions of pattern recognition. The fundamental basis of recognition is the theory of pattern recognition. The paper discusses pattern recognition systems, the environment and application areas of these systems, and the requirements for their development and improvement. It presents tasks such as license plate recognition, facial recognition, and gesture recognition. The field of computer vision in image recognition, specifically hand gestures, is also addressed. The development of software will enable the testing of the trained model's effectiveness and its application for laboratory purposes, allowing for adjustments to improve the model.Keywords
This publication has 18 references indexed in Scilit:
- Enhancement of surgical hand gesture recognition using a capsule network for a contactless interface in the operating roomComputer Methods and Programs in Biomedicine, 2020
- A Deep Convolutional Neural Network Approach for Static Hand Gesture RecognitionProcedia Computer Science, 2020
- American Sign Language Character Recognition with Capsule Networks2019
- Pattern Recognition with Using Effective Algorithms and Methods of Computer Vision Library2019
- CNN+RNN Depth and Skeleton based Dynamic Hand Gesture Recognition2018
- Hand Gesture Recognition Using Infrared Imagery Provided by Leap Motion Controller2016
- Real-time environmental sensor data: An application to water quality using web servicesEnvironmental Modelling & Software, 2016
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Future Internet technologies for environmental applicationsEnvironmental Modelling & Software, 2016
- Data Analysis Using Regression and Multilevel/Hierarchical Models2006