End-to-End Reinforcement Learning for Torque Based Variable Height Hopping
Authors:
- 1 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7531-7538
Abstract
Legged locomotion is arguably the most suited and versatile mode to deal with natural or unstructured terrains. Intensive research into dynamic walking and running controllers has recently yielded great advances, both in the optimal control and reinforcement learning (RL) literature. Hopping is a challenging dynamic task involving a flight phase and has the potential to increase the traversability of legged robots. Model based control for hopping typically relies on accurate detection of different jump phases, such as lift-off or touch down, and using different controllers for each phase. In this paper, we present a end-to-end RL based torque controller that learns to implicitly detect the relevant jump phases, removing the need to provide manual heuristics for state detection. We also extend a method for simulation to reality transfer of the learned controller to contact rich dynamic tasks, resulting in successful deployment on the robot after training without parameter tuning.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Engineered jumpers overcome biological limits via work multiplicationNature, 2022
- Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots2021
- Bio-inspired neuromuscular reflex based hopping controller for a segmented robotic legBioinspiration & Biomimetics, 2020
- Learning Jumping Skills From Human with a Fast Reinforcement Learning Framework2018
- Sim-to-Real Transfer of Robotic Control with Dynamics Randomization2018
- 3D dynamic walking with underactuated humanoid robots: A direct collocation framework for optimizing hybrid zero dynamics2016
- Principles of sensorimotor learningNature Reviews Neuroscience, 2011
- An optimal control model unifying holonomic and nonholonomic walking2008
- Control algorithms for a vertically-constrained one-legged hopping machine2002
- Approximation theory of the MLP model in neural networksActa Numerica, 1999