Joint AMC and Resource Allocation for Mobile Wireless Networks Based on Distributed MARL
Authors:
- 16 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 397-402
Abstract
With the rapid development of intelligent devices, the fifth-generation (5G) mobile wireless networks are envisioned to support massive connections and higher capacity. To confront challenges on link inefficiency in traditional mobile wireless networks, the link adaptation technology is crucial for system capacity improvements and requires coordination with resource allocation strategy. In this paper, we consider a joint adaptive modulation and coding (AMC) and resource allocation (RA) in a wireless network, where multiple users share limited subcarriers and adaptively change modulation levels and transmit power with the target to maximize the long-term system throughput. Instead of using optimization theory-based methods with higher complexity, we propose an intelligent double deep Q-network (DDQN)-based AMC and RA algorithm, which regards users as agents that learn cooperatively from their past experiences and implement their policies distributively. Furthermore, to guarantee fairness among users, we re-design the multi-agent reinforcement learning (MARL) reward function to incorporate the attained proportional fairness of each user at the current cycle into our objective. Simulation results demonstrate that users successfully learn to collaborate in a distributed manner, which leads to improved throughput both of the single link level and the whole system level.Keywords
Funding Information
- National Key R&D Program of China (2020YFB1807101,2018YFB1801104)
- National Natural Science Foundation of China (U20A20158,61725104)
This publication has 13 references indexed in Scilit:
- The Roadmap to 6G: AI Empowered Wireless NetworksIEEE Communications Magazine, 2019
- Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular NetworksIEEE Transactions on Wireless Communications, 2019
- Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless NetworksIEEE Journal on Selected Areas in Communications, 2019
- Deep Reinforcement Learning-Based Modulation and Coding Scheme Selection in Cognitive Heterogeneous NetworksIEEE Transactions on Wireless Communications, 2019
- Joint Link Adaptation and Scheduling for 5G Ultra-Reliable Low-Latency CommunicationsIEEE Access, 2018
- Bipartite Graph Based Proportional Fair Resource Allocation for D2D Communication2017
- Uplink Scheduling and Link Adaptation for Narrowband Internet of Things SystemsIEEE Access, 2017
- Proportional Fair Space–Time Scheduling for Wireless CommunicationsIEEE Transactions on Communications, 2005
- Opportunistic beamforming using dumb antennasIEEE Transactions on Information Theory, 2002
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998