Joint Resource Allocation for UAV-Assisted V2X Communication With Mean Field Multi-Agent Reinforcement Learning
- 23 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (1) , 1209-1223
Abstract
The Vehicle-to-Everything (V2X) communication, as the fundamental part of intelligent transport system, has the potential to increase road safety and traffic efficiency. However, conventional static infrastructures like roadside units (RSUs) often encounter overload issues due to the uneven spatiotemporal distribution of vehicles. Although the line-of-sight (LoS) propagation characteristics and high mobility of unmanned aerial vehicles (UAVs) have brought about UAV-assisted vehicular communication. The scarce spectrum resources, complex interference, restricted energy budgets, and the mobility of automobiles still pose significant challenges. In this paper, we combine mean-field game (MFG) theory with multi-agent reinforcement learning (MARL) to allocate resources for RSUs and UAVs in non-orthogonal multiple access (NOMA) V2X communication networks. To find rational and reasonable global solutions for infrastructures under power and QoS constraints, a joint sub-band scheduling and transmit power allocation problem is addressed. The MARL technique is utilized to endow agents with the capability of self-learning. MFG theory is employed to tackle the tremendous overhead in agent interactions. The integration of MFG and MARL enables infrastructures to act as agents, engaging in mutual interactions and considering the impact of the surrounding environment, to achieve maximum global energy efficiency. Simulation results demonstrate the effectiveness of UAV-assisted V2X communication and prove that the proposed method outperforms a state-of-the-art resource allocation scheme in both average energy efficiency and probability of failure.Keywords
Funding Information
- National Key R&D Program of China (2022YFC3006400)
- Fundamental Research Funds for the Central Universities, China (2023CDJKYJH073, 2023CDJKYJH016)
- Science and Technology Innovation Key R&D Program of Chongqing, China (CSTB2022TIAD-KPX0099)
- Transportation Science and Technology Program of Chongqing, China (CQJT-2024CZ6-1)
This publication has 45 references indexed in Scilit:
- Graph neural network-based scheduling for multi-UAV-enabled communications in D2D networksDigital Communications and Networks, 2024
- UAV-UGV-Based System for AoI minimization in IoT Networks2023
- A survey of UAV-based data collection: Challenges, solutions and future perspectivesJournal of Network and Computer Applications, 2023
- Multi-UAV Assisted Network Coverage Optimization for Rescue Operations using Reinforcement Learning2023
- Age of Information Based Scheduling for UAV Aided Emergency Communication Networks2022
- Maximizing Sum Rate by Joint Control and Communication Scheduling for RIS-Assisted Cellular Connected UAV in THz Communications2022
- Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2022
- UAV assistance paradigm: State-of-the-art in applications and challengesJournal of Network and Computer Applications, 2020
- Resource and Power Allocation in SWIPT-Enabled Device-to-Device Communications Based on a Nonlinear Energy Harvesting ModelIEEE Internet of Things Journal, 2020
- Deep-Learning-Based Joint Resource Scheduling Algorithms for Hybrid MEC NetworksIEEE Internet of Things Journal, 2019