Tactile-Based Insertion for Dense Box-Packing
Authors:
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7953-7960
Abstract
We study the problem of using high-resolution tactile sensors to control the insertion of objects in a boxpacking scenario. In this paper, we propose an insertion strategy that leverages tactile sensing to: 1) safely probe the box with the grasped object while monitoring incipient slip to maintain a stable grasp on the object. 2) estimate and correct for residual position uncertainties to insert the object into a designated gap without disturbing the environment.Our proposed methodology is based on two neural networks that estimate the error direction and error magnitude, from a stream of tactile imprints, acquired by two GelSlim fingers, during the insertion process. The system is trained on four objects with basic geometric shapes, which we show generalizes to four other common objects. Based on the estimated positional errors, a heuristic controller iteratively adjusts the position of the object and eventually inserts it successfully without requiring prior knowledge of the geometry of the object. The key insight is that dense tactile feedback contains useful information with respect to the contact interaction between the grasped object and its environment. We achieve high success rate and show that unknown objects can be inserted with an average of 6 attempts of the probe-correct loop. The method’s ability to generalize to novel objects makes it a good fit for box packing in warehouse automation.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Shape-independent hardness estimation using deep learning and a GelSight tactile sensor2017
- Analysis and Observations From the First Amazon Picking ChallengeIEEE Transactions on Automation Science and Engineering, 2016
- Long-term recurrent convolutional networks for visual recognition and description2015
- Going deeper with convolutions2015
- SCARA based peg-in-hole assembly using compliant IPMC micro gripperRobotics and Autonomous Systems, 2013
- Peg-on-hole: a model based solution to peg and hole alignment2002
- Search strategies for peg-in-hole assemblies with position uncertainty2002
- Interpretation of force and moment signals for compliant peg-in-hole assembly2002
- Long Short-Term MemoryNeural Computation, 1997
- Quasi-Static Assembly of Compliantly Supported Rigid PartsJournal of Dynamic Systems, Measurement, and Control, 1982