Reinforcement Learning Control of a Flexible Two-Link Manipulator: An Experimental Investigation
Top Cited Papers
- 5 March 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 51 (12) , 7326-7336
Abstract
This article discusses the control design and experiment validation of a flexible two-link manipulator (FTLM) system represented by ordinary differential equations (ODEs). A reinforcement learning (RL) control strategy is developed that is based on actor–critic structure to enable vibration suppression while retaining trajectory tracking. Subsequently, the closed-loop system with the proposed RL control algorithm is proved to be semi-global uniform ultimate bounded (SGUUB) by Lyapunov’s direct method. In the simulations, the control approach presented has been tested on the discretized ODE dynamic model and the analytical claims have been justified under the existence of uncertainty. Eventually, a series of experiments in a Quanser laboratory platform are investigated to demonstrate the effectiveness of the presented control and its application effect is compared with PD control.Keywords
Funding Information
- National Natural Science Foundation of China (61933001, 61873298)
- National Key Research and Development Program of China (2019YFB1703600)
- Joint Funds of Equipment Preresearch and Ministry of Education of China (6141A02033339)
- Beijing Top Discipline for Artificial Intelligent Science and Engineering, University Science and Technology Beijing
This publication has 60 references indexed in Scilit:
- Sliding mode control to stabilization of cascaded heat PDE–ODE systems subject to boundary control matched disturbanceAutomatica, 2015
- The Concept of “Attractive Region in Environment” and its Application in High-Precision Tasks With Low-Precision SystemsIEEE/ASME Transactions on Mechatronics, 2014
- Dynamic Modeling and Noncollocated Control of a Flexible Planar Cable-Driven ManipulatorIEEE Transactions on Robotics, 2014
- Reinforcement Learning Output Feedback NN Control Using Deterministic Learning TechniqueIEEE Transactions on Neural Networks and Learning Systems, 2013
- Reinforcement learning and optimal adaptive control: An overview and implementation examplesAnnual Reviews in Control, 2012
- An intelligent sliding mode controller for vibration suppression in flexible structuresJournal of Vibration and Control, 2011
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problemAutomatica, 2010
- A 3D Finite Element Method for Flexible Multibody SystemsMultibody System Dynamics, 2006
- OnActor-Critic AlgorithmsSIAM Journal on Control and Optimization, 2003
- Assumed modes method and articulated flexible multibody dynamicsJournal of Guidance, Control, and Dynamics, 1995