Dealing with Limited Backhaul Capacity in Millimeter-Wave Systems: A Deep Reinforcement Learning Approach
Authors:
- Mingjie FengMFMingjie Feng
- Shiwen MaoSMShiwen Mao
- 11 March 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 57 (3) , 50-55
Abstract
Millimeter-wave (mmWave) communication is a key technology of fifth generation wireless systems to achieve the expected 1000x data rate. With large bandwidth at the mmWave band, the link capacity between users and base stations (BSs) can be much higher compared to sub-6 GHz wireless systems. Meanwhile, due to the high cost of infrastructure upgrade, it would be difficult for operators to drastically enhance the capacity of backhaul links between mmWave BSs and the core network. As a result, the data rate provided by backhaul may not be sufficient to support all mmWave links; hence, the backhaul connection becomes the new bottleneck. On the other hand, as mmWave channels are subject to random blockage, the data rates of mmWave users significantly vary over time. With limited backhaul capacity and highly dynamic data rates of users, how to allocate backhaul resource to each user remains a challenge for mmWave systems. In this article, we present a deep reinforcement learning (DRL) approach to address this challenge. By learning the blockage pattern, the system dynamics can be captured and predicted, resulting in efficient utilization of backhaul resource. We begin with a discussion on DRL and its application in wireless systems. We then investigate the problem of backhaul resource allocation and present the DRL-based solution. Finally, we discuss open problems for future research and conclude this article.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Experience-driven Networking: A Deep Reinforcement Learning based Approach2018
- Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless NetworksIEEE Transactions on Cognitive Communications and Networking, 2018
- Joint Frame Design, Resource Allocation and User Association for Massive MIMO Heterogeneous Networks With Wireless BackhaulIEEE Transactions on Wireless Communications, 2017
- Deep Multi-User Reinforcement Learning for Dynamic Spectrum Access in Multichannel Wireless Networks2017
- Deep-Reinforcement-Learning-Based Optimization for Cache-Enabled Opportunistic Interference Alignment Wireless NetworksIEEE Transactions on Vehicular Technology, 2017
- 5G Ultra-Dense Cellular NetworksIEEE Wireless Communications, 2016
- Balancing backhaul load in heterogeneous cloud radio access networksIEEE Wireless Communications, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Millimeter Wave Channel Modeling and Cellular Capacity EvaluationIEEE Journal on Selected Areas in Communications, 2014
- Energy-Efficient Resource Allocation in Multi-Cell OFDMA Systems with Limited Backhaul CapacityIEEE Transactions on Wireless Communications, 2012