Fine-Tuning Quadcopter Control Parameters via Deep Actor-Critic Learning Framework: An Exploration of Nonlinear Stability Analysis and Intelligent Gain Tuning
Open Access
- 19 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 173462-173474
Abstract
Quadcopters have underactuated, nonlinear, and coupled dynamics, making their control a challenging endeavor. However, PID controllers have exhibited remarkable performance for such systems in a variety of circumstances, including obstacle avoidance, trajectory tracking, and route planning. The outer loop handles mission-level goals, while the inner loop is responsible for its stability and control. Nevertheless, gain optimization for nonlinear systems using heuristics or rule-based approaches is a laborious, time-consuming, and challenging task. This study implements an optimal gain self-tuning framework for the altitude, attitude, and position controllers of a 6 DoF nonlinear drone system using a Deep Reinforcement Learning (DRL) algorithm with continuous observation and action spaces. The state equations are determined using Lagrange’s (energy-based) technique, whilst the aerodynamic coefficients are computed numerically using Blade Element Momentum Theory (BEMT). In addition, the asymptotic stability of the cascaded closed loop nonlinear system is investigated using the theory of Lyapunov. The proposed technique is validated via simulations, which demonstrate that the quadcopter can closely follow a specified trajectory by using the optimized gains. Most notably, these optimal gains fulfill the constraints derived from Lyapunov’s stability analysis, suggesting that the RL technique is an incredibly powerful instrument that can evaluate the uncertainties present in any complicated nonlinear system.Keywords
This publication has 57 references indexed in Scilit:
- Super-twisting Sliding Mode Control of Container Cranes With Triangle-trapezoid Rope Reeving SystemInternational Journal of Control, Automation, and Systems, 2024
- Observer‐based adaptive backstepping control and the application for a class of multi‐input multi‐output nonlinear systems with structural uncertainties and perturbationsInternational Journal of Robust and Nonlinear Control, 2023
- Sliding mode output feedback control for continuous systems without rank constraintInternational Journal of Robust and Nonlinear Control, 2023
- Reinforcement learning approach to autonomous PID tuningComputers & Chemical Engineering, 2022
- On the Design and Development of Vision-based Tactile SensorsJournal of Intelligent & Robotic Systems, 2021
- Adaptive PID Controller Using Sliding Mode Control Approaches for Quadrotor UAV Attitude and Position StabilizationArabian Journal for Science and Engineering, 2020
- Automatic Gain Tuning Method of a Quad-Rotor Geometric Attitude Controller Using A3CInternational Journal of Aeronautical and Space Sciences, 2019
- Parameters tuning of a quadrotor PID controllers by using nature-inspired algorithmsEvolutionary Intelligence, 2019
- Reinforcement learning for control: Performance, stability, and deep approximatorsAnnual Reviews in Control, 2018
- Model predictive control: Review of the three decades of developmentInternational Journal of Control, Automation, and Systems, 2011