Stealth UAV Path Planning Based on DDQN Against Multi-Radar Detection
Open Access
Abstract
Considering the dynamic RCS characteristics of stealthy UAVs, we proposed a stealthy UAV path planning algorithm based on the Double Deep Q-Network (DDQN). By introducing the reinforcement learning model that can interact with the environment, the stealth UAV adjusts the path planning strategy through the rewards obtained from the environment to design the optimal path in real-time. Specifically, by considering the effect of RCS from different angles on the detection probability of the air defense radar, the stealth UAV realizes the iterative optimization of the path planning scheme to improve the reliability of the penetration path. Under the guidance of a goal-directed composite reward function proposed, the convergence speed of the stealth UAV path planning algorithm is improved. The simulation results show that the stealth UAV can reach the target position with the optimal path while avoiding the threat zone.Keywords
Funding Information
- Technology Innovation Talent Project of the National University of Defense Technology (202501-YJRC-XX-022)
This publication has 20 references indexed in Scilit:
- An Improved Artificial Potential Field Method for Path Planning and Formation Control of the Multi-UAV SystemsIEEE Transactions on Circuits and Systems II: Express Briefs, 2021
- Safety-enhanced UAV path planning with spherical vector-based particle swarm optimizationApplied Soft Computing, 2021
- UAV Path Planning under Dynamic Threats Using an Improved PSO AlgorithmInternational Journal of Aerospace Engineering, 2020
- Rapid Penetration Path Planning Method for Stealth UAV in Complex Environment with BB ThreatsInternational Journal of Aerospace Engineering, 2020
- A Novel Real-Time Penetration Path Planning Algorithm for Stealth UAV in 3D Complex Dynamic EnvironmentIEEE Access, 2020
- Path planning techniques for unmanned aerial vehicles: A review, solutions, and challengesComputer Communications, 2020
- Application of the ACO algorithm for UAV path planningPRZEGLĄD ELEKTROTECHNICZNY, 2019
- A Space Mapping Based 0–1 Linear Model for Onboard Conflict Resolution of Heterogeneous Unmanned Aerial VehiclesIEEE Transactions on Vehicular Technology, 2019
- Path Planning for Active SLAM Based on the D* Algorithm With Negative Edge WeightsIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2017
- Human-level control through deep reinforcement learningNature, 2015