Multiagent Collaborative Learning for UAV Enabled Wireless Networks
- 15 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Selected Areas in Communications
- Vol. 40 (9) , 2630-2642
Abstract
The unmanned aerial vehicle (UAV) technique provides a potential solution to scalable wireless edge networks. This paper uses two UAVs, with accelerated motions and fixed altitudes, to realize a wireless edge network, where one UAV forwards downlink signals to user terminals (UTs) distributed over an area while the other one collects uplink data. The conditional average achievable rates, as well as their lower bounds, of both the uplink and downlink transmission are derived considering the active probability of UTs and the service queues of two UAVs. In addition, a problem aiming to maximize the energy efficiency of the whole system is formulated, which takes into account communication related energy and propulsion energy consumption. Then, we develop a novel multi-agent Q-learning (MA-QL) algorithm to maximize the energy efficiency, through optimizing the trajectory and transmit power of the UAVs. Finally, simulation results are conducted to verify our analysis and examine the impact of different parameters on the downlink and uplink achievable rates, UAV energy consumption, and system energy efficiency. It is demonstrated that the proposed algorithm achieves much higher energy efficiency than other benchmark schemes.Keywords
Funding Information
- Natural Science Foundation on Frontier Leading Technology Basic Research Project of Jiangsu (BK20212001)
- Project funded by British Council (913030644)
- U.K. Engineering and Physical Sciences Research Council (EP/T015985/1, EP/N007840/1)
- National Natural Science Foundation of China (62071352, 92067201)
This publication has 48 references indexed in Scilit:
- Downlink Coverage Analysis for a Finite 3D Wireless Network of Unmanned Aerial VehiclesIEEE Transactions on Communications, 2017
- Energy-Efficient UAV Communication With Trajectory OptimizationIEEE Transactions on Wireless Communications, 2017
- Wireless Power Transfer in Massive MIMO-Aided HetNets With User AssociationIEEE Transactions on Communications, 2016
- Survey of Important Issues in UAV Communication NetworksIEEE Communications Surveys & Tutorials, 2015
- Generation of Spectral–Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture ApplicationsIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- An Introduction to Queueing Theory2015
- Coverage and Rate Analysis for Millimeter-Wave Cellular NetworksIEEE Transactions on Wireless Communications, 2014
- Micro aerial vehicle networks: an experimental analysis of challenges and opportunitiesIEEE Communications Magazine, 2014
- Game Theory and Multi-agent Reinforcement Learning2012
- Q-learningMachine Learning, 1992