Towards Autonomous Robotic Assembly: Using Combined Visual and Tactile Sensing for Adaptive Task Execution
Open Access
- 20 February 2021
- journal article
- research article
- Published by Springer Nature in Journal of Intelligent & Robotic Systems
- Vol. 101 (3) , 1-22
Abstract
Robotic assembly tasks are typically implemented in static settings in which parts are kept at fixed locations by making use of part holders. Very few works deal with the problem of moving parts in industrial assembly applications. However, having autonomous robots that are able to execute assembly tasks in dynamic environments could lead to more flexible facilities with reduced implementation efforts for individual products. In this paper, we present a general approach towards autonomous robotic assembly that combines visual and intrinsic tactile sensing to continuously track parts within a single Bayesian framework. Based on this, it is possible to implement object-centric assembly skills that are guided by the estimated poses of the parts, including cases where occlusions block the vision system. In particular, we investigate the application of this approach for peg-in-hole assembly. A tilt-and-align strategy is implemented using a Cartesian impedance controller, and combined with an adaptive path executor. Experimental results with multiple part combinations are provided and analyzed in detail.Keywords
This publication has 56 references indexed in Scilit:
- Integrated task and motion planning in belief spaceThe International Journal of Robotics Research, 2013
- Integration of planning and execution in force controlled compliant motionRobotics and Autonomous Systems, 2007
- The DLR lightweight robot: design and control concepts for robots in human environmentsIndustrial Robot: the international journal of robotics research and application, 2007
- A Unified Passivity-based Control Framework for Position, Torque and Impedance Control of Flexible Joint RobotsThe International Journal of Robotics Research, 2007
- Localizing a polyhedral object in a robot hand by integrating visual and tactile dataPattern Recognition, 2000
- Probabilistic roadmaps for path planning in high-dimensional configuration spacesIEEE Transactions on Robotics and Automation, 1996
- Novel approach to nonlinear/non-Gaussian Bayesian state estimationIEE Proceedings F Radar and Signal Processing, 1993
- Using Backprojections for Fine Motion Planning with UncertaintyThe International Journal of Robotics Research, 1986
- Automatic Synthesis of Fine-Motion Strategies for RobotsThe International Journal of Robotics Research, 1984
- A self-learning automaton with variable resolution for high precision assembly by industrial robotsIEEE Transactions on Automatic Control, 1982