Learning-Based Propulsion Control for Amphibious Quadruped Robots With Dynamic Adaptation to Changing Environment
- 11 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (12) , 7889-7896
Abstract
This letter proposes a learning-based adaptive propulsion control (APC) method for a quadruped robot integrated with thrusters in amphibious environments, allowing it to move efficiently in water while maintaining its ground locomotion capabilities. We designed the specific reinforcement learning method to train the neural network to perform the vector propulsion control. Our approach coordinates the legs and propeller, enabling the robot to achieve speed and trajectory tracking tasks in the presence of actuator failures and unknown disturbances. Our simulated validations of the robot in water demonstrate the effectiveness of the trained neural network to predict the disturbances and actuator failures based on historical information, showing that the framework is adaptable to changing environments and is suitable for use in dynamically changing situations. Our proposed approach is suited to the hardware augmentation of quadruped robots to create avenues in the field of amphibious robotics and expand the use of quadruped robots in various applications.Keywords
Funding Information
- Applied Basic Research Program of Liaoning Province (2022020403-JH2/1013)
- National Key Research and Development Program of China (2022YFB4701900)
- National Natural Science Foundation of China (61821005)
- Open Research Project of the State Key Laboratory of Industrial Control Technology, Zhejiang University, China (ICT2023B50)
- China Scholarship Council
- Jiang Xinsong Innovation Fund (E2510202)
This publication has 29 references indexed in Scilit:
- Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learningRobotics and Autonomous Systems, 2018
- Design, development, and control of a tough electrohydraulic hexapod robot for subsea operationsAdvanced Robotics, 2018
- Omnidirectional Aerial Vehicles With Unidirectional Thrusters: Theory, Optimal Design, and ControlIEEE Robotics and Automation Letters, 2018
- On a CPG-Based Hexapod Robot: AmphiHex-II With Variable Stiffness LegsIEEE/ASME Transactions on Mechatronics, 2018
- Design, swimming motion planning and implementation of a legged underwater robot (CALEB10: D.BeeBot) by biomimetic approachOcean Engineering, 2017
- Development of arm and leg for seabed walking robot CRABSTER200Ocean Engineering, 2016
- Learning legged swimming gaits from experience2015
- Human-level control through deep reinforcement learningNature, 2015
- Development of a Spherical Underwater Robot Equipped with Multiple Vectored Water-Jet-Based ThrustersJournal of Intelligent & Robotic Systems, 2012
- Reinforcement Learning and Markov Decision Processes2012