Gait Balance and Acceleration of a Biped Robot Based on Q-Learning
Authors:
Open Access
- 18 May 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 4, 2439-2449
Abstract
This paper presents a method for the biped dynamic walking and balance control using reinforcement learning, which learns dynamic walking without a priori knowledge about the dynamic model. The learning architecture developed is aimed to solve complex control problems in robotic actuation control by mapping the action space from a discretized domain to a continuous one. It employs the discrete actions to construct a policy for continuous action. The architecture allows for the scaling of the dimensionality of the state space and cardinality of the action set that represents new knowledge, or new requirements for a desired task. The balance learning method utilizing the motion of robot arm and leg to shift the zero moment point on the soles of a robot can maintain the biped robot in a static stable state. This balanced algorithm is applied to biped walking on a flat surface and a seesaw and is making the biped's walks more stable. The simulation shows that the proposed method can allow the robot to learn to improve its behavior in terms of walking speed. Finally, the methods are implemented on a physical biped robot to demonstrate the feasibility and effectiveness of the proposed learning scheme.Keywords
Funding Information
- MOST Taiwan
This publication has 17 references indexed in Scilit:
- A biped gait learning algorithm for humanoid robots based on environmental impact assessed artificial bee colonyIEEE Access, 2015
- Humanoid robot gait imitation2014
- Postural Balance Strategies in Response to Disturbances in the Frontal Plane and Their Implementation With a Humanoid RobotIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2013
- A UKF-Based Predictable SVR Learning Controller for Biped WalkingIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2013
- Gyroscope integrated environmental mode compliance control for biped robot2012
- Walking Motion Generation, Synthesis, and Control for Biped Robot by Using PGRL, LPI, and Fuzzy LogicIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2010
- Human-Like Walking: Optimal Motion of a Bipedal Robot With Toe-Rotation MotionIEEE/ASME Transactions on Mechatronics, 2010
- Associative reinforcement learning of real-valued functions2002
- Q-learningMachine Learning, 1992
- A stochastic reinforcement learning algorithm for learning real-valued functionsNeural Networks, 1990