A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation
Authors:
- 23 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2476-2482
Abstract
Reinforcement learning shows great potential to solve complex contact-rich robot manipulation tasks. However, the safety of using RL in the real world is a crucial problem, since unexpected dangerous collisions might happen when the RL policy is imperfect during training or in unseen scenarios. In this paper, we propose a contact-safe reinforcement learning framework for contact-rich robot manipulation, which maintains safety in both the task space and joint space. When the RL policy causes unexpected collisions between the robot arm and the environment, our framework is able to immediately detect the collision and ensure the contact force to be small. Furthermore, the end-effector is enforced to perform contact-rich tasks compliantly, while keeping robust to external disturbances. We train the RL policy in simulation and transfer it to the real robot. Real world experiments on robot wiping tasks show that our method is able to keep the contact force small both in task space and joint space even when the policy is under unseen scenario with unexpected collision, while rejecting the disturbances on the main task.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Learning Robotic Assembly from CAD2018
- Robot Collisions: A Survey on Detection, Isolation, and IdentificationIEEE Transactions on Robotics, 2017
- Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collectionThe International Journal of Robotics Research, 2017
- TRAC-IK: An open-source library for improved solving of generic inverse kinematics2015
- Exploitation of environmental constraints in human and robotic graspingThe International Journal of Robotics Research, 2015
- An overview of null space projections for redundant, torque-controlled robotsThe International Journal of Robotics Research, 2015
- Stability Analysis for Prioritized Closed-Loop Inverse Kinematic Algorithms for Redundant Robotic SystemsIEEE Transactions on Robotics, 2009
- Sensorless Robot Collision Detection and Hybrid Force/Motion Control2005
- Task-Priority Based Redundancy Control of Robot ManipulatorsThe International Journal of Robotics Research, 1987
- A unified approach for motion and force control of robot manipulators: The operational space formulationIEEE Journal on Robotics and Automation, 1987