A Multimodal Teach-in Approach to the Pick-and-Place Problem in Human-Robot Collaboration
Open Access
- 13 March 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 81-85
Abstract
Teaching robotic systems how to carry out a task in a collaborative environment still presents a challenge. This is because replicating natural human-to-human interaction requires the availability of interaction modalities that allow conveying complex information. Speech, gestures, gaze-based interactions as well as directly guiding a robotic system count towards such modalities that yield the potential to enable smooth multimodal human-robot interaction. This paper presents a conceptual approach for multimodally teaching a robotic system how to pick-and-place an object, one of the fundamental tasks not only in robotics, but in everyday life. By establishing task and dialogue model separately, we aim to split robot/task logic from interaction logic and to achieve modality independence for the teaching interaction. Finally, we elaborate on an experimental implementation of our models for multimodally teaching a UR-10 robot arm how to pick-and-place an object.Keywords
Funding Information
- German Federal Ministry of Education and Research (01IW20008)
This publication has 20 references indexed in Scilit:
- Pick and place mobile robot for the disabled through voice commands2017
- Initiative in robot assistance during collaborative task execution2016
- Visual pointing gestures for bi-directional human robot interaction in a pick-and-place task2015
- Understanding Human Hand Gestures for Learning Robot Pick-and-Place TasksInternational Journal of Advanced Robotic Systems, 2015
- EEG control of an industrial robot manipulator2013
- Perception and motion planning for pick-and-place of dynamic objects2013
- Pick‐and‐place application development using voice and visual commandsIndustrial Robot: the international journal of robotics research and application, 2012
- Human-robot cooperation: safe pick-and-place operations2006
- A human-robot interface using an interactive hand pointer that projects a mark in the real work space2002
- Task-level planning of pick-and-place robot motionsComputer, 1989