A Method for UAV Path Planning Based on G-MAPONet Reinforcement Learning
Open Access
Abstract
To address the issues of efficiency and robustness in UAV trajectory planning under complex environments, this paper proposes a Graph Multi-Head Attention Policy Optimization Network (G-MAPONet) algorithm that integrates Graph Attention (GAT), Multi-Head Attention (MHA), and Group Relative Policy Optimization (GRPO). The algorithm adopts a three-layer architecture of “GAT layer for local feature perception–MHA for global semantic reasoning–GRPO for policy optimization”, comprehensively achieving the goals of dynamic graph convolution quantization and global adaptive parallel decoupled dynamic strategy adjustment. Comparative experiments in multi-dimensional spatial environments demonstrate that the Gat_Mha combined mechanism exhibits significant superiority compared to single attention mechanisms, which verifies the efficient representation capability of the dual-layer hybrid attention mechanism in capturing environmental features. Additionally, ablation experiments integrating Gat, Mha, and GRPO algorithms confirm that the dual-layer fusion mechanism of Gat and Mha yields better improvement effects. Finally, comparisons with traditional reinforcement learning algorithms across multiple performance metrics show that the G-MAPONet algorithm reduces the number of convergence episodes (NCE) by an average of more than 19.14%, increases the average reward (AR) by over 16.20%, and successfully completes all dynamic path planning (PPTC) tasks; meanwhile, the algorithm’s reward values and obstacle avoidance success rate are significantly higher than those of other algorithms. Compared with the baseline APF algorithm, its reward value is improved by 8.66%, and the obstacle avoidance repetition rate is also enhanced, which further verifies the effectiveness of the improved G-MAPONet algorithm. In summary, through the dual-layer complementary mode of GAT and MHA, the G-MAPONet algorithm overcomes the bottlenecks of traditional dynamic environment modeling and multi-scale optimization, enhances the decision-making capability of UAVs in unstructured environments, and provides a new technical solution for trajectory planning in intelligent logistics and distribution.Keywords
Funding Information
- The National Social Science Fund of China (22&ZD169)
- the Key project of Civil Aviation Joint Fund of National Natural Science Foundation of China (U2133207)
This publication has 48 references indexed in Scilit:
- A multistage stochastic programming approach for drone-supported last-mile humanitarian logistics system planningAdvanced Engineering Informatics, 2025
- Combinatorial optimization for UAV swarm path planning and task assignment in multi-obstacle battlefield environmentApplied Soft Computing, 2025
- UAV formation path planning for mountainous forest terrain utilizing an artificial rabbit optimizer incorporating reinforcement learning and thermal conduction search strategiesAdvanced Engineering Informatics, 2024
- 3D UAV path planning in unknown environment: A transfer reinforcement learning method based on low-rank adaptionAdvanced Engineering Informatics, 2024
- A multi-objective cat swarm optimization algorithm based on two-archive mechanism for UAV 3-D path planning problemApplied Soft Computing, 2024
- Optimizing UAV-UGV coalition operations: A hybrid clustering and multi-agent reinforcement learning approach for path planning in obstructed environmentAd Hoc Networks, 2024
- Goal distance-based UAV path planning approach, path optimization and learning-based path estimation: GDRRT*, PSO-GDRRT* and BiLSTM-PSO-GDRRT*Applied Soft Computing, 2023
- RGSO-UAV: Reverse Glowworm Swarm Optimization inspired UAV path-planning in a 3D dynamic environmentAd Hoc Networks, 2022
- A novel reinforcement learning based grey wolf optimizer algorithm for unmanned aerial vehicles (UAVs) path planningApplied Soft Computing, 2020
- A truck and drones model for last-mile delivery: A mathematical model and heuristic approachApplied Mathematical Modelling, 2020