Context-aware robot control using gesture episodes
Preprint
Abstract
Collaborative robots became a popular tool for increasing productivity in partly automated manufacturing plants. Intuitive robot teaching methods are required to quickly and flexibly adapt the robot programs to new tasks. Gestures have an essential role in human communication. However, in human-robot-interaction scenarios, gesture-based user interfaces are so far used rarely, and if they employ a one-to-one mapping of gestures to robot control variables. In this paper, we propose a method that infers the user's intent based on gesture episodes, the context of the situation, and common sense. The approach is evaluated in a simulated table-top manipulation setting. We conduct deterministic experiments with simulated users and show that the system can even handle personal preferences of each user.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Gesture-Based Human–Machine Interaction: Taxonomy, Problem Definition, and AnalysisIEEE Transactions on Cybernetics, 2021
- Hand Gesture Recognition with Leap Motion2018
- Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand GesturesIEEE Transactions on Multimedia, 2018
- Hand gesture recognition with jointly calibrated Leap Motion and depth sensorMultimedia Tools and Applications, 2015
- A Kinect-Based Gesture Recognition Approach for a Natural Human Robot InterfaceInternational Journal of Advanced Robotic Systems, 2015
- Analysis of the Accuracy and Robustness of the Leap Motion ControllerSensors, 2013
- Toward accurate dynamic time warping in linear time and spaceIntelligent Data Analysis: An International Journal, 2007
- Dynamic Time Warping2007