Robotic Learning the Sequence of Packing Irregular Objects from Human Demonstrations
Authors:
- André SantosASAndré Santos
- Nuno Ferreira DuarteNDNuno Ferreira Duarte
- Atabak DehbanADAtabak Dehban
- José Santos-VictorJSJosé Santos-Victor
Preprint
Abstract
We tackle the challenge of robotic bin packing with irregular objects, such as groceries. Given the diverse physical attributes of these objects and the complex constraints governing their placement and manipulation, employing preprogrammed strategies becomes unfeasible. Our approach is to learn directly from expert demonstrations in order to extract implicit task knowledge and strategies to ensure safe object positioning, efficient use of space, and the generation of human-like behaviors that enhance human-robot trust. We rely on human demonstrations to learn a Markov chain for predicting the object packing sequence for a given set of items and then compare it with human performance. Our experimental results show that the model outperforms human performance by generating sequence predictions that humans classify as human-like more frequently than human-generated sequences. The human demonstrations were collected using our proposed VR platform, BoxED, which is a box packaging environment for simulating real-world objects and scenarios for fast and streamlined data collection with the purpose of teaching robots. We collected data from 43 participants packing a total of 263 boxes with supermarket-like objects, yielding 4644 object manipulations. Our VR platform can be easily adapted to new scenarios and objects, and is publicly available, alongside our dataset, at https://github.com/andrejfsantos4/BoxED.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Bayesian Disturbance Injection: Robust Imitation Learning of Flexible Policies2021
- Human-Centered Collaborative Robots With Deep Reinforcement LearningIEEE Robotics and Automation Letters, 2020
- Robot Packing With Known Items and Nondeterministic Arrival OrderIEEE Transactions on Automation Science and Engineering, 2020
- Grasping in the Wild: Learning 6DoF Closed-Loop Grasping From Low-Cost DemonstrationsIEEE Robotics and Automation Letters, 2020
- Recent Advances in Robot Learning from DemonstrationAnnual Review of Control, Robotics, and Autonomous Systems, 2020
- End-to-End Driving Via Conditional Imitation Learning2018
- Efficient behavior learning in human–robot collaborationAutonomous Robots, 2017
- Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model SetIEEE Robotics & Automation Magazine, 2015
- Raised conditional level of significance for the 2 × 2‐table when testing the equality of two probabilitiesStatistica Neerlandica, 1970