MASP: Scalable Graph-Based Planning Towards Multi-UAV Navigation
Open Access
Abstract
This work investigates multi-UAV navigation tasks where multiple drones need to reach initially unassigned goals in a limited time. Reinforcement learning (RL) has recently become a popular approach for such tasks. However, RL struggles with low sample efficiency when directly exploring (nearly) optimal policies in a large exploration space, especially with an increased number of drones (e.g., 10+ drones) or in complex environments (e.g., a 3D quadrotor simulator). To address these challenges, this paper proposes Multi-UAV Scalable Graph-based Planner (MASP), a goal-conditioned hierarchical planner that reduces space complexity by decomposing the large exploration space into multiple goal-conditioned subspaces. MASP consists of a high-level policy that optimizes goal assignment and a low-level policy that promotes goal navigation. MASP uses a graph-based representation and introduces an attention-based mechanism as well as a group division mechanism to enhance cooperation between drones and adaptability to varying team sizes. The results demonstrate that MASP outperforms RL and planning-based baselines in task and execution efficiency. Compared to planning-based competitors, MASP improves task efficiency by over 27.92% in a 3D continuous quadrotor environment with 20 drones.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62406159, 62325405, GZC20240830, 2024M761676, 2024T170496)
- Postdoctoral Fellowship Program of CPSF (62406159, 62325405, GZC20240830, 2024M761676, 2024T170496)
- China Postdoctoral Science Special Foundation (62406159, 62325405, GZC20240830, 2024M761676, 2024T170496)
This publication has 48 references indexed in Scilit:
- Research on multi-UAV autonomous obstacle avoidance algorithm integrating improved dynamic window approach and ORCAScientific Reports, 2025
- High-Sample-Efficient Multiagent Reinforcement Learning for Navigation and Collision Avoidance of UAV Swarms in Multitask EnvironmentsIEEE Internet of Things Journal, 2024
- Distributed Multi-UAV Trajectory Planning for Downlink Transmission: A GNN-Enhanced DRL ApproachIEEE Wireless Communications Letters, 2024
- Graph-based multi-agent reinforcement learning for large-scale UAVs swarm system controlAerospace Science and Technology, 2024
- OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone ControlIEEE Robotics and Automation Letters, 2024
- Active Neural Topological Mapping for Multi-Agent ExplorationIEEE Robotics and Automation Letters, 2023
- Hierarchical Goal-Guided Learning for the Evasive Maneuver of Fixed-Wing UAVs based on Deep Reinforcement LearningJournal of Intelligent & Robotic Systems, 2023
- LSAR: Multi-UAV Collaboration for Search and Rescue MissionsIEEE Access, 2019
- Goal assignment and trajectory planning for large teams of interchangeable robotsAutonomous Robots, 2014
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955