Self-Tuning Sectorization: Deep Reinforcement Learning Meets Broadcast Beam Optimization
- 19 March 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 19 (6) , 4038-4053
Abstract
Beamforming in multiple input multiple output (MIMO) systems is one of the key technologies for modern wireless communication. Creating appropriate sector-specific broadcast beams are essential for enhancing the coverage of cellular network and for improving the broadcast operation for control signals. However, in order to maximize the coverage, patterns for broadcast beams need to be adapted based on the users’ distribution and movement over time. In this work, we present self-tuning sectorization: a deep reinforcement learning framework to optimize MIMO broadcast beams autonomously and dynamically based on user’ distribution in the network. Taking directly UE measurement results as input, deep reinforcement learning agent can track and predict the UE distribution pattern and come up with the best broadcast beams for each cell. Extensive simulation results show that the introduced framework can achieve the optimal coverage, and converge to the oracle solution for both single sector and multiple sectors environment, and for both periodic and Markov mobility patterns.Keywords
All Related Versions
Funding Information
- U.S. National Science Foundation (ECCS-1811497, CCF-1937487)
- U.S. NSF (1642873)
This publication has 21 references indexed in Scilit:
- Angle and Delay Estimation for 3-D Massive MIMO/FD-MIMO Systems Based on Parametric Channel ModelingIEEE Transactions on Wireless Communications, 2017
- DoA Estimation and Capacity Analysis for 3-D Millimeter Wave Massive-MIMO/FD-MIMO OFDM SystemsIEEE Transactions on Wireless Communications, 2016
- Human-level control through deep reinforcement learningNature, 2015
- What Will 5G Be?IEEE Journal on Selected Areas in Communications, 2014
- Full dimension mimo (FD-MIMO): the next evolution of MIMO in LTE systemsIEEE Wireless Communications, 2014
- Five disruptive technology directions for 5GIEEE Communications Magazine, 2014
- Distributed Cooperative Q-Learning for Power Allocation in Cognitive Femtocell Networks2012
- Noncooperative Cellular Wireless with Unlimited Numbers of Base Station AntennasIEEE Transactions on Wireless Communications, 2010
- >tex<$Q$>/tex<-Learning-Based Multirate Transmission Control Scheme for RRM in Multimedia WCDMA SystemsIEEE Transactions on Vehicular Technology, 2004
- A Q-learning-based dynamic channel assignment technique for mobile communication systemsIEEE Transactions on Vehicular Technology, 1999