A Reinforcement Learning Method Based on an Improved Sampling Mechanism for Unmanned Aerial Vehicle Penetration
Open Access
Abstract
The penetration of unmanned aerial vehicles (UAVs) is an important aspect of UAV games. In recent years, UAV penetration has generally been solved using artificial intelligence methods such as reinforcement learning. However, the high sample demand of the reinforcement learning method poses a significant challenge specifically in the context of UAV games. To improve the sample utilization in UAV penetration, this paper innovatively proposes an improved sampling mechanism called task completion division (TCD) and combines this method with the soft actor critic (SAC) algorithm to form the TCD-SAC algorithm. To compare the performance of the TCD-SAC algorithm with other related baseline algorithms, this study builds a dynamic environment, a UAV game, and conducts training and testing experiments in this environment. The results show that among all the algorithms, the TCD-SAC algorithm has the highest sample utilization rate and the best actual penetration results, and the algorithm has a good adaptability and robustness in dynamic environments.Keywords
This publication has 36 references indexed in Scilit:
- Autonomous Landing of Fixed Wing Unmanned Aerial Vehicle with Reactive Collision AvoidanceIFAC-PapersOnLine, 2018
- Improved Gradient-Based Algorithm for Solving Aeroassisted Vehicle Trajectory Optimization ProblemsJournal of Guidance, Control, and Dynamics, 2017
- Atmospheric vehicle trajectory optimization with minimum dynamic pressure constraintProceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, 2017
- Hypersonic Skipping Trajectory Planning for High L/D Gliding Vehicles2017
- Maneuver characteristics analysis for hypersonic glide vehiclesAerospace Science and Technology, 2015
- Backstepping attitude control for hypersonic gliding vehicle based on a robust dynamic inversion approachProceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, 2014
- Design, performance evaluation and optimization of a UAVAerospace Science and Technology, 2013
- Trajectory optimization for terminal phase flight of hypersonic reentry vehicles with multi-constraints2013
- Proportional navigation-based collision avoidance for UAVsInternational Journal of Control, Automation, and Systems, 2009
- A Markovian Decision ProcessIndiana University Mathematics Journal, 1957