DiG-Net: Enhancing Human–Robot Interaction through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics
Open Access
- 15 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 15 (4) , 1-24
Abstract
Dynamic hand gestures play a pivotal role in assistive Human–Robot Interaction (HRI), facilitating intuitive, non-verbal communication, particularly for individuals with mobility constraints or those operating robots remotely. Current gesture recognition methods are mostly limited to short-range interactions, reducing their utility in scenarios demanding robust assistive communication from afar. In this article, we present Distance-Aware Gesture Network (DiG-Net), the first dynamic gesture recognition framework enabling robust operation at hyper-range distances of up to 30 meters, specifically designed for assistive robotics to enhance accessibility and improve quality of life. Our proposed DiG-Net effectively combines Depth-Conditioned Deformable Alignment (DADA) blocks with Spatio-Temporal Graph modules, enabling robust processing and classification of gesture sequences captured under challenging conditions, including significant physical attenuation, reduced resolution, and dynamic gesture variations commonly experienced in real-world assistive environments. We further introduce the Radiometric Spatio‐Temporal Depth Attenuation Loss (RSTDAL), shown to enhance learning and strengthen model robustness across varying distances. Our model demonstrates significant performance improvement over state-of-the-art gesture recognition frameworks, achieving a recognition accuracy of 97.3% on a diverse dataset with challenging hyper-range gestures. By effectively interpreting gestures from considerable distances, DiG-Net significantly enhances the usability of assistive robots in home healthcare, industrial safety, and remote assistance scenarios, enabling seamless and intuitive interactions for users regardless of physical limitations.Keywords
All Related Versions
Funding Information
- Israel Innovation Authority (77857)
This publication has 46 references indexed in Scilit:
- Mask-guided multiscale feature aggregation network for hand gesture recognitionPattern Recognition, 2023
- A Review of Hand Gesture Recognition Systems Based on Noninvasive Wearable SensorsAdvanced Intelligent Systems, 2023
- Linked motion image‐based dynamic hand gesture recognitionComputer Animation and Virtual Worlds, 2023
- Dynamic gesture recognition based on 2D convolutional neural network and feature fusionScientific Reports, 2022
- Dynamic gesture recognition by using CNNs and star RGB: A temporal information condensationNeurocomputing, 2020
- Robust real-time hand detection and localization for space human–robot interaction based on deep learningNeurocomputing, 2020
- Minimum distance calculation using laser scanner and IMUs for safe human-robot interactionRobotics and Computer-Integrated Manufacturing, 2019
- Gesture-based human-robot interaction for human assistance in manufacturingThe International Journal of Advanced Manufacturing Technology, 2018
- Dynamic hand gesture recognition using motion pattern and shape descriptorsMultimedia Tools and Applications, 2018
- The Beer-Lambert LawJournal of Chemical Education, 1962