SAPIEN: A SimulAted Part-Based Interactive ENvironment
Authors:
Top Cited Papers
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 11094-11104
Abstract
Building home assistant robots has long been a goal for vision and robotics researchers. To achieve this task, a simulated environment with physically realistic simulation, sufficient articulated objects, and transferability to the real robot is indispensable. Existing environments achieve these requirements for robotics simulation with different levels of simplification and focus. We take one step further in constructing an environment that supports household tasks for training robot learning algorithm. Our work, SAPIEN, is a realistic and physics-rich simulated environment that hosts a large-scale set of articulated objects. SAPIEN enables various robotic vision and interaction tasks that require detailed part-level understanding.We evaluate state-of-the-art vision algorithms for part detection and motion attribute recognition as well as demonstrate robotic interaction tasks using heuristic approaches and reinforcement learning algorithms. We hope that SAPIEN will open research directions yet to be explored, including learning cognition through interaction, part motion discovery, and construction of robotics-ready simulated game environment.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Cognitive Mapping and Planning for Visual Navigation2017
- Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collectionThe International Journal of Robotics Research, 2017
- Yale-CMU-Berkeley dataset for robotic manipulation researchThe International Journal of Robotics Research, 2017
- Deep Residual Learning for Image Recognition2016
- MuJoCo: A physics engine for model-based control2012
- Comprehensive Simulation of Quadrotor UAVs Using ROS and Gazebo2012
- OptiXACM Transactions on Graphics, 2010
- Simbad: An Autonomous Robot Simulation Package for Education and Research2006
- Design and use paradigms for gazebo, an open-source multi-robot simulator2005
- A tutorial on visual servo controlIEEE Transactions on Robotics and Automation, 1996