Trace Pheromone-Based Energy-Efficient UAV Dynamic Coverage Using Deep Reinforcement Learning
- 5 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 10 (3) , 1063-1074
Abstract
Unmanned aerial vehicles (UAVs) are widely used in disaster or remote areas to provide ubiquitous service. Due to the limited energy and communication range of UAVs, and the operation of UAVs is subject to high uncertainty, current coverage path planning algorithms are not sufficient. Therefore, autonomous dynamic and energy-efficient path planning is still an important research direction for improving coverage efficiency, especially involving multiagent. To address this problem, we introduce a novel trace pheromone into multi-agent reinforcement learning framework for energy-efficient UAV dynamic coverage control, which is termed trace pheromone-based UAV energy-efficient dynamic coverage (TP-EDC). First, we combine multi-agent deep deterministic policy gradient (MADDPG) with a trace pheromone model to serve as a strong tool for building our TP-EDC framework. Meanwhile, the trace pheromones model is integrated into stigmergy mechanism to simulate natural pheromones, which enhances the inner indirect communications among distributed UAVs and avoids network delay. Finally, the intensive simulation results demonstrate that the proposed method can maximize the coverage efficiency by comprehensively considering the coverage rate and energy consumption. Our method also shows significant dynamic coverage performance compared to two well-known baselines methods.Keywords
Funding Information
- National Key Research and Development Program of China (2020AAA0108905)
- National Natural Science Foundation of China (61825303, 62273262, 62088101, U1713215)
- Shanghai Science and Technology Commission Project (21ZR1466400, 22QA1408500, 2021SHZDZX0100)
- Fundamental Research Funds for the Central Universities
This publication has 32 references indexed in Scilit:
- UAV-Assisted Sleep Scheduling Algorithm for Energy-Efficient Data Collection in Agricultural Internet of ThingsIEEE Internet of Things Journal, 2021
- A distributed deployment algorithm for communication coverage in wireless robotic networksJournal of Network and Computer Applications, 2021
- A Path Planning Method for Sweep Coverage With Multiple UAVsIEEE Internet of Things Journal, 2020
- Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT NetworksIEEE Internet of Things Journal, 2020
- Rechargeable Multi-UAV Aided Seamless Coverage for QoS-Guaranteed IoT NetworksIEEE Internet of Things Journal, 2019
- Joint UAV Hovering Altitude and Power Control for Space-Air-Ground IoT NetworksIEEE Internet of Things Journal, 2018
- Energy-efficient multi-UAV coverage deployment in UAV networks: A game-theoretic frameworkChina Communications, 2018
- Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning ApproachIEEE Journal on Selected Areas in Communications, 2018
- Pseudo-bearing Measurements for Improved Localization of Radio Sources with Multirotor UAVs2018
- Energy Efficiency for Unmanned Aerial Vehicles2011