Fusing visual and tactile sensing for 3-D object reconstruction while grasping
- 1 May 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 3547-3554
Abstract
In this work, we propose to reconstruct a complete 3-D model of an unknown object by fusion of visual and tactile information while the object is grasped. Assuming the object is symmetric, a first hypothesis of its complete 3-D shape is generated from a single view. This initial model is used to plan a grasp on the object which is then executed with a robotic manipulator equipped with tactile sensors. Given the detected contacts between the fingers and the object, the full object model including the symmetry parameters can be refined. This refined model will then allow the planning of more complex manipulation tasks. The main contribution of this work is an optimal estimation approach for the fusion of visual and tactile data applying the constraint of object symmetry. The fusion is formulated as a state estimation problem and solved with an iterative extended Kalman filter. The approach is validated experimentally using both artificial and real data from two different robotic platforms.Keywords
This publication has 21 references indexed in Scilit:
- Grasping unknown objects using an Early Cognitive Vision system for general scene understanding2011
- Combined 2D–3D categorization and classification for multimodal perception systemsThe International Journal of Robotics Research, 2011
- Robust robot-camera calibration2011
- Symmetric piecewise planar object reconstruction from a single image2011
- Efficient grasping from RGBD images: Learning using a new rectangle representation2011
- Gaussian process implicit surfaces for shape estimation and grasping2011
- Robotic Grasping of Novel Objects using VisionThe International Journal of Robotics Research, 2008
- A method of 3D object reconstruction by fusing vision with touch using internal models with global and local deformations2002
- Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- Integrating Vision and Touch for Object Recognition TasksThe International Journal of Robotics Research, 1988