Power Allocation in Multi-User Cellular Networks with Deep Q Learning Approach
Authors:
- Fan MengFMFan Meng
- Peng ChenPCPeng Chen
- Lenan WuLWLenan Wu
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches are rapidly developing in this field, and among them the deep reinforcement learning (DRL) is proved to be of great potential. Different from supervised learning, the DRL takes advantages of exploration and exploitation to maximize the objective function under certain constraints. In our paper, we propose a two-step training framework. First, with the off-line learning in simulated environment, a deep Q network (DQN) is trained with deep Q learning (DQL) algorithm, which is well-designed to be in consistent with this PA issue. Second, the DQN will be further fine-tuned with real data in on-line training procedure. The simulation results show that the proposed DQN achieves the highest averaged sum-rate, comparing to the ones with present standard DQL training. With different user densities, our DQN outperforms benchmark algorithms and thus a good generalization ability is verified.Keywords
This publication has 14 references indexed in Scilit:
- Fractional Programming for Communication Systems—Part I: Power Control and BeamformingIEEE Transactions on Signal Processing, 2018
- An Introduction to Deep Learning for the Physical LayerIEEE Transactions on Cognitive Communications and Networking, 2017
- Power of Deep Learning for Channel Estimation and Signal Detection in OFDM SystemsIEEE Wireless Communications Letters, 2017
- A reinforcement learning approach to power control and rate adaptation in cellular networks2017
- Deep learningNature, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Weighted Sum-Rate Maximization in Multi-Cell Networks via Coordinated Scheduling and Discrete Power ControlIEEE Journal on Selected Areas in Communications, 2011
- An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel2011
- Power Control in Wireless Cellular NetworksFoundations and Trends® in Networking, 2008
- Jakes fading model revisitedElectronics Letters, 1993