Design of a Reinforcement Learning-Based Speed Compensator for Unmanned Aerial Vehicle in Complex Environments
Open Access
Abstract
Due to the complexity of the marine environment and the uncertainty of ship movements, altitude control of UAV is particularly important when approaching and landing on the deck of a ship. This paper focuses on unmanned helicopters as its research subject. Conventional altitude control systems may have difficulty in ensuring fast and stable landings under certain extreme conditions. Therefore, designing a new UAV altitude control method that can adapt to complex sea conditions has become a current problem to be solved. Designing a reinforcement learning based rotational speed compensator for UAV as a redundant controller to optimise UAV altitude control performance for the above problem. The compensator is capable of adjusting the UAV’s rotational speed in real time to compensate for altitude deviations due to external environmental disturbances and the UAV’s own dynamic characteristics. By introducing reinforcement learning algorithms, especially the DDPG algorithm, this compensator is able to learn the optimal RPM adjustment strategy in a continuous trial-and-error process, which improves the UAV’s rapidity and stability during the landing process.Keywords
This publication has 30 references indexed in Scilit:
- Modeling and full-speed range transition strategy for a compound helicopterAerospace Science and Technology, 2025
- A survey on security of UAV and deep reinforcement learningAd Hoc Networks, 2024
- Dynamic modeling and analysis of traction operation process for the shipboard helicopterAerospace Science and Technology, 2023
- Dynamics analysis and control of coaxial high-speed helicopter in transition flightAerospace Science and Technology, 2023
- Autonomous navigation of UAV in multi-obstacle environments based on a Deep Reinforcement Learning approachApplied Soft Computing, 2022
- Experimental study of a helicopter model in shipboard operationsAerospace Science and Technology, 2021
- Numerical investigation on the ship/multi-helicopter dynamic interfaceAerospace Science and Technology, 2020
- Infinite horizon model predictive control tracking application to helicoptersAerospace Science and Technology, 2020
- Adaptive control for multi-rotor UAVs autonomous ship landing with mission planningAerospace Science and Technology, 2020
- Fixed-time autonomous shipboard landing control of a helicopter with external disturbancesAerospace Science and Technology, 2019