Double‐deep Q‐learning‐based handover management in mmWave heterogeneous networks with dual connectivity
Authors:
- 10 December 2023
- journal article
- research article
- Published by Wiley in Transactions on Emerging Telecommunications Technologies
- Vol. 35 (1)
Abstract
Millimeter wave (mmWave) technology, with its abundant spectrum resources and ultra‐high bandwidth, plays a crucial role in meeting the ultra‐high throughput requirements of future 6G communication and supporting a large number of device connections. However, mmWave signals are highly susceptible to congestion, and the channel quality in mmWave links can be extremely unstable, posing a significant challenge to mobility management in mmWave networks. In this article, we present a deep reinforcement learning‐based dual connectivity (DC) handover strategy for mmWave cellular networks. The DC architecture ensures a continuous connection to the core network, reducing the likelihood of frequent service interruptions. Additionally, the proposed handover strategy employs deep reinforcement learning to select the optimal handover target node, further enhancing system performance. Compared to traditional single connectivity (SC) handover strategies, DC involves more intricate handover trigger conditions and processes. We extend several typical SC handover algorithms for DC and compare them with the proposed algorithms in this study. Through numerical simulations, we evaluate the performance of these algorithms. The results demonstrate that the proposed algorithm minimizes unnecessary handovers, reduces service interruption time, and achieves the highest throughput.Keywords
Funding Information
- National Natural Science Foundation of China
This publication has 37 references indexed in Scilit:
- 3D non-stationary vehicle-to-vehicle MIMO channel model for 5G millimeter-wave communicationsDigital Signal Processing, 2019
- A Seamless Handover Scheme With Assisted eNB for 5G C/U Plane Split Heterogeneous NetworkIEEE Access, 2019
- MACHINE LEARNING FOR RELIABLE MMWAVE SYSTEMS: BLOCKAGE PREDICTION AND PROACTIVE HANDOFF2018
- A Hierarchical SDN Architecture for Ultra-Dense Millimeter-Wave Cellular NetworksIEEE Communications Magazine, 2018
- Performance Evaluation and Analysis of Millimeter Wave Communication SystemIEEE Systems Journal, 2018
- Millimeter-Wave Communications: Physical Channel Models, Design Considerations, Antenna Constructions, and Link-BudgetIEEE Communications Surveys & Tutorials, 2017
- The SMART Handoff Policy for Millimeter Wave Heterogeneous Cellular NetworksIEEE Transactions on Mobile Computing, 2017
- Improved Handover Through Dual Connectivity in 5G mmWave Mobile NetworksIEEE Journal on Selected Areas in Communications, 2017
- Coverage and Rate Analysis for Millimeter-Wave Cellular NetworksIEEE Transactions on Wireless Communications, 2014
- A Survey of Wireless Path Loss Prediction and Coverage Mapping MethodsIEEE Communications Surveys & Tutorials, 2012