Manipulation Skill Acquisition for Robotic Assembly Based on Multi-Modal Information Description
Authors:
Open Access
- 9 August 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 6282-6294
Abstract
Automatic assembly of elastic components is difficult because of the potential deformation of parts during the assembly process. Consequently, robots cannot adapt their manipulation to dynamic changes. Designing systems that learn assembly skills can help in alleviating the uncertain factor for industrial-grade assembly robots. This study proposes a skill acquisition method based on multi-modal information description to realize the assembly of systems with elastic components. This multi-modal information includes two-dimensional images, poses, forces/torques, and robot joint parameters. In this method, robots acquire searching, location determination, and pose adjustment skills using these multi-modal information parameters. As a result, robots can reach the assembly target by analyzing two-dimensional images with no position constraint. While acquiring pose adjustment skills, the reward function with depth and assembly steps is used to improve the learning efficiency. The deep deterministic policy gradient (DDPG) algorithm is applied for acquiring skills. Experiments using a KUKA iiwa robot demonstrated the effectiveness and conciseness of our method. Our results indicate that the robot acquired searching, location determination, and pose adjustment skills that allowed it to successfully complete elastic assembly.Keywords
Funding Information
- National Natural Science Foundation of China (U1509212)
- Natural Science Foundation of Shandong Province (ZR2018ZC0437)
- Key Research and Development Plan of Shandong Province, China (2017CXGC0915)
This publication has 30 references indexed in Scilit:
- Hand–Eye Calibration in Visually-Guided Robot GrindingIEEE Transactions on Cybernetics, 2015
- Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface2015
- Contact-state Modeling of Robotic Assembly Tasks Using Gaussian Mixture ModelsProcedia CIRP, 2014
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Recent progress on programming methods for industrial robotsRobotics and Computer-Integrated Manufacturing, 2012
- Reinforcement learning of motor skills with policy gradientsNeural Networks, 2008
- Teaching and learning of robot tasks via observation of human performanceRobotics and Autonomous Systems, 2004
- Complete solution classification for the perspective-three-point problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Acquiring robust, force-based assembly skills from human demonstrationIEEE Transactions on Robotics and Automation, 2000