A reinforcement learning control approach for underwater manipulation under position and torque constraints
Preprint
Abstract
In marine operations underwater manipulators play a primordial role. However, due to uncertainties in the dynamic model and disturbances caused by the environment, low-level control methods require great capabilities to adapt to change. Furthermore, under position and torque constraints the requirements for the control system are greatly increased. Reinforcement learning is a data driven control technique that can learn complex control policies without the need of a model. The learning capabilities of these type of agents allow for great adaptability to changes in the operative conditions. In this article we present a novel reinforcement learning low-level controller for the position control of an underwater manipulator under torque and position constraints. The reinforcement learning agent is based on an actor-critic architecture using sensor readings as state information. Simulation results using the Reach Alpha 5 underwater manipulator show the advantages of the proposed control strategy.Keywords
All Related Versions
- Version 1, 2020-11-24, ArXiv
- Published version: , 1.
This publication has 15 references indexed in Scilit:
- A survey of underwater docking guidance systemsRobotics and Autonomous Systems, 2020
- A Passivity-Based Approach for Kinematic Control of Manipulators With ConstraintsIEEE Transactions on Industrial Informatics, 2019
- Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learningRobotics and Autonomous Systems, 2018
- Trajectory Tracking Control of an Autonomous Underwater Vehicle Using Lyapunov-Based Model Predictive ControlIEEE Transactions on Industrial Electronics, 2017
- Incremental Q -learning strategy for adaptive PID control of mobile robotsExpert Systems with Applications, 2017
- Adaptive Control of Robotic Manipulators With Unified Motion ConstraintsIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2016
- Solution of Fixed Final State Optimal Control Problems via Simple Cell MappingNonlinear Dynamics, 2000
- Optimum Settings for Automatic ControllersJournal of Dynamic Systems, Measurement, and Control, 1993
- Model predictive control: Theory and practice—A surveyAutomatica, 1989
- Dynamic hybrid position/force control of robot manipulators--Description of hand constraints and calculation of joint driving forceIEEE Journal on Robotics and Automation, 1987