Augmented Kinesthetic Teaching: Enhancing Task Execution Efficiency through Intuitive Human Instructions
Authors:
- Cheng TangCTCheng Tang
- Jiaming ZhongJZJiaming Zhong
- Yue HuYHYue Hu
Preprint
Abstract
In this paper, we present a complete and efficient implementation of a knowledge-sharing augmented kinesthetic teaching approach for efficient task execution in robotics. Our augmented kinesthetic teaching method integrates intuitive human feedback, including verbal, gesture, gaze, and physical guidance, to facilitate the extraction of multiple layers of task information including control type, attention direction, input and output type, action state change trigger, etc., enhancing the adaptability and autonomy of robots during task execution. We propose an efficient Programming by Demonstration (PbD) framework for users with limited technical experience to teach the robot in an intuitive manner. The proposed framework provides an interface for such users to teach customized tasks using high-level commands, with the goal of achieving a smoother teaching experience and task execution. This is demonstrated with the sample task of pouring water.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Symbolic representation of what robots are taught in one demonstrationRobotics and Autonomous Systems, 2023
- Manipulation Planning Using Object-Centered Predicates and Hierarchical Decomposition of Contextual ActionsIEEE Robotics and Automation Letters, 2020
- Learning attentional regulations for structured tasks execution in robotic cognitive controlAutonomous Robots, 2019
- Simultaneous learning of hierarchy and primitives for complex robot tasksAutonomous Robots, 2018
- Kinesthetic teaching and attentional supervision of structured tasks in human–robot interactionAutonomous Robots, 2018
- Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic InputAdvanced Robotics, 2011