Real-Time 3-D MIMO Antenna Tuning With Deep Reinforcement Learning
- 14 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 8 (2) , 1202-1215
Abstract
The 3D MIMO in 5G system requires adaptive and real-time adjustment of antenna azimuth angle, downtilt and beam combination according to the user distribution, which is a powerful technique to improve coverage and capacity. However, due to the complicated interactions between cells and complex environments, it is challengeable to jointly tune the antenna of multiple cells. Besides, the user distribution is complicated because of huge number of users and variable user locations. In this paper, a practical real-time 3D MIMO antenna tuning method with deep reinforcement learning (DRL) is proposed to jointly adjust the antenna configuration according to time-varying user distributions to improve the coverage and access performance of the system. Specifically, a deep neural network is trained to configure the antenna parameters and the Multi-agent reinforcement learning (MARL) is used to adapt various user distributions. The proposed method has been verified on a 5G simulation environment with real geographical features from the real network of China Mobile. Simulation results indicate that the proposed method can improve the coverage and access performance compared with the typical schemes used in practical networks.Keywords
This publication has 37 references indexed in Scilit:
- 3D channel model in 3GPPIEEE Communications Magazine, 2015
- Human-level control through deep reinforcement learningNature, 2015
- What Will 5G Be?IEEE Journal on Selected Areas in Communications, 2014
- Online Antenna Tilt-Based Capacity and Coverage OptimizationIEEE Wireless Communications Letters, 2014
- Self-optimization of coverage and capacity based on a fuzzy neural network with cooperative reinforcement learningEURASIP Journal on Wireless Communications and Networking, 2014
- Friendship and mobility2011
- Mining periodic behaviors for moving objects2010
- Limits of Predictability in Human MobilityScience, 2010
- Reinforcement distribution for fuzzy classifiers: a methodology to extend crisp algorithms1998
- Generalized best-first search strategies and the optimality of A*Journal of the ACM, 1985