Efficient Multi-UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach
Authors:
- 31 July 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 39-44
Abstract
This paper presents a multi-agent reinforcement learning (MARL) framework designed to optimize the path planning of multiple unmanned aerial vehicles (UAVs) for wireless data harvesting missions. The proposed approach leverages Double Deep Q-Networks (DDQN) with State-Action-Reward-State-Action (SARSA) and Q-learning algorithms to improve learning efficiency and overall performance.In our framework, UAVs operate in a decentralized manner, learning their policies independently through interactions with a grid-based environment that includes no-fly zones, buildings, start and landing zones, and sensor locations. Extensive simulations demonstrate that the DDQN-based algorithm significantly outperforms SARSA and Q-learning in terms of maximizing data collection, minimizing collisions, and achieving faster convergence, underscoring its potential to enhance UAV operations in dynamicKeywords
This publication has 9 references indexed in Scilit:
- Model-Aided Federated Reinforcement Learning for Multi-UAV Trajectory Planning in IoT Networks2023
- Multi-Agent Reinforcement Learning Aided Resource Allocation With SARSA in UAV Networks2023
- Muti-Agent Proximal Policy Optimization For Data Freshness in UAV-assisted Networks2023
- Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement LearningIEEE Open Journal of the Communications Society, 2021
- Accessing From the Sky: A Tutorial on UAV Communications for 5G and BeyondProceedings of the IEEE, 2019
- Computation Rate Maximization in UAV-Enabled Wireless-Powered Mobile-Edge Computing SystemsIEEE Journal on Selected Areas in Communications, 2018
- Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless NetworksIEEE Transactions on Wireless Communications, 2018
- Throughput Maximization for UAV-Enabled Mobile Relaying SystemsIEEE Transactions on Communications, 2016
- Model-Free Trajectory Optimisation for Unmanned Aircraft Serving as Data Ferries for Widespread SensorsRemote Sensing, 2012