Deepbots: A Webots-Based Deep Reinforcement Learning Framework for Robotics
- 29 May 2020
- book chapter
- Published by Springer Nature
- Vol. 584, 64-75
Abstract
Deep Reinforcement Learning (DRL) is increasingly used to train robots to perform complex and delicate tasks, while the development of realistic simulators contributes to the acceleration of research on DRL for robotics. However, it is still not straightforward to employ such simulators in the typical DRL pipeline, since their steep learning curve and the enormous amount of development required to interface with DRL methods significantly restrict their use by researchers. To overcome these limitations, in this work we present an open-source framework that combines an established interface used by DRL researchers, the OpenAI Gym interface, with the state-of-the-art Webots robot simulator in order to provide a standardized way to employ DRL in various robotics scenarios. Deepbots aims to enable researchers to easily develop DRL methods in Webots by handling all the low-level details and reducing the required development effort. The effectiveness of the proposed framework is demonstrated through code examples, as well as using three use cases of varying difficulty.Keywords
This publication has 7 references indexed in Scilit:
- Sample-Efficient Model-Free Reinforcement Learning with Off-Policy Critics2020
- Gym-Ignition: Reproducible Robotic Simulations for Reinforcement Learning2020
- Deep learningNature, 2015
- MuJoCo: A physics engine for model-based control2012
- The iCub humanoid robot2008
- Design and use paradigms for gazebo, an open-source multi-robot simulator2005
- Cyberbotics Ltd. Webots ™ : Professional Mobile Robot SimulationInternational Journal of Advanced Robotic Systems, 2004