A Framework for Real-Time Gestural Recognition and Augmented Reality for Industrial Applications
Open Access
Abstract
In recent decades, technological advancements have transformed the industry, highlighting the efficiency of automation and safety. The integration of augmented reality (AR) and gesture recognition has emerged as an innovative approach to create interactive environments for industrial equipment. Gesture recognition enhances AR applications by allowing intuitive interactions. This study presents a web-based architecture for the integration of AR and gesture recognition, designed to interact with industrial equipment. Emphasizing hardware-agnostic compatibility, the proposed structure offers an intuitive interaction with equipment control systems through natural gestures. Experimental validation, conducted using Google Glass, demonstrated the practical viability and potential of this approach in industrial operations. The development focused on optimizing the system’s software and implementing techniques such as normalization, clamping, conversion, and filtering to achieve accurate and reliable gesture recognition under different usage conditions. The proposed approach promotes safer and more efficient industrial operations, contributing to research in AR and gesture recognition. Future work will include improving the gesture recognition accuracy, exploring alternative gestures, and expanding the platform integration to improve the user experience.Keywords
Funding Information
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brasil (CAPES) (001)
This publication has 21 references indexed in Scilit:
- A Review of Hand Gesture Recognition Systems Based on Noninvasive Wearable SensorsAdvanced Intelligent Systems, 2023
- Enhancing Virtual and Augmented Reality Interactions with a MediaPipe-Based Hand Gesture Recognition User InterfaceIngénierie des Systèmes d'information, 2023
- Hand Gesture Recognition Based on Various Deep Learning YOLO ModelsInternational Journal of Advanced Computer Science and Applications, 2023
- Augmented Reality: A Comprehensive ReviewArchives of Computational Methods in Engineering, 2022
- Hand Gesture Recognition with Augmented Reality and Leap Motion Controller2021
- Augmented Reality Assisted Assembly Training Oriented Dynamic Gesture Recognition and PredictionApplied Sciences, 2021
- A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture RecognitionIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2021
- OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity FieldsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- LPSNet: A Novel Log Path Signature Feature Based Hand Gesture Recognition Framework2017
- Automatic generation and detection of highly reliable fiducial markers under occlusionPattern Recognition, 2014