Multi-UAV Coverage Path Planning: A Distributed Online Cooperation Method
Top Cited Papers
- 13 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 72 (9) , 11727-11740
Abstract
Coverage path planning (CPP) for unmanned aerial vehicles (UAVs) plays a significant role in intelligent distributed surveillance systems. However, due to poor cooperation, most existing CPP methods may cause strongly overlapped trajectories, missing areas, or even collisions in uncertain and complex environments, leading to long task completion time and low coverage efficiency. To this end, in this paper we propose a novel multi-UAV distributed online cooperation (MDOC) CPP method that aims to minimize task completion time. Moreover, this method allows UAVs to quickly respond to unknown obstacles and complex emergencies, such as UAV breakdown or communication interruption. To establish close cooperation between UAVs, we propose an efficient environmental information map (EI-map) fusion technique that enables them to obtain global exploration in real-time in a cooperative manner. Then we innovatively develop a distributed cooperative deep Q-learning (DCDQN) algorithm to obtain UAVs' coverage paths online that are determined by minimizing task time and avoiding overlaps, missing areas, and collisions. Specifically, attributing to the fused EI-map, we expand the state space of DCDQN to collect sufficient observations and design a novel cooperative learning pattern to efficiently plan the path for global optimization. Simulation results show that our method outperforms the state-of-the-art in task completion time and coverage efficiency, especially in uncertain and complex environments. In addition, we validate that our method can efficiently complete full coverage even in emergencies.Keywords
Funding Information
- National Natural Science Foundation of China (62171113)
This publication has 29 references indexed in Scilit:
- Multi-UAV Oxyrrhis Marina-Inspired Search and Dynamic Formation Control for Forest FirefightingIEEE Transactions on Automation Science and Engineering, 2018
- Territorial Marking for Improved Area Coverage in Anti-Flocking-Controlled Mobile Sensor Networks2018
- $\varepsilon ^{\star }$ : An Online Coverage Path Planning AlgorithmIEEE Transactions on Robotics, 2018
- Optimal UAV Route Planning for Coverage Search of Stationary Target in RiverIEEE Transactions on Control Systems Technology, 2017
- Cooperative search of UAV swarm based on improved ant colony algorithm in uncertain environment2017
- A Hybrid Path Planning Method in Unmanned Air/Ground Vehicle (UAV/UGV) Cooperative SystemsIEEE Transactions on Vehicular Technology, 2016
- Distributed Antiflocking Algorithms for Dynamic Coverage of Mobile Sensor NetworksIEEE Transactions on Industrial Informatics, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Coverage path planning for mobile robot based on genetic algorithm2014
- A survey on coverage path planning for roboticsRobotics and Autonomous Systems, 2013