Using Simulation to Evaluate a Tube Perception Algorithm for Bin Picking
Open Access
Abstract
Bin picking is a challenging problem that involves using a robotic manipulator to remove, one-by-one, a set of objects randomly stacked in a container. In order to provide ground truth data for evaluating heuristic or machine learning perception systems, this paper proposes using simulation to create bin picking environments in which a procedural generation method builds entangled tubes that can have curvatures throughout their length. The output of the simulation is an annotated point cloud, generated by a virtual 3D depth camera, in which the tubes are assigned with unique colors. A general metric based on micro-recall is proposed to compare the accuracy of point cloud annotations with the ground truth. The synthetic data is representative of a high quality 3D scanner, given that the performance of a tube modeling system when given 640 simulated point clouds was similar to the results achieved with real sensor data. Therefore, simulation is a promising technique for the automated evaluation of solutions for bin picking tasks.Keywords
Funding Information
- Fundação para a Ciência e a Tecnologia (2020.06923.BD)
- European Social Fund Plus (NORTE-06-3559-FSE-000116)
This publication has 17 references indexed in Scilit:
- Learning Based Industrial Bin-Picking Trained with Approximate Physics Simulator2018
- A LiDAR Point Cloud Generator2018
- Benchmarking motion planning algorithms for bin-picking applicationsIndustrial Robot: the international journal of robotics research and application, 2017
- Playing for Data: Ground Truth from Computer Games2016
- The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes2016
- Realistic simulation of industrial bin-picking systems2015
- 3D is here: Point Cloud Library (PCL)2011
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009
- Design and use paradigms for gazebo, an open-source multi-robot simulator2005
- GraspIt!IEEE Robotics & Automation Magazine, 2004