5G Network on Wings: A Deep Reinforcement Learning Approach to the UAV-Based Integrated Access and Backhaul
Open Access
- 13 August 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Machine Learning in Communications and Networking
- Vol. 2, 1109-1126
Abstract
Fast and reliable wireless communication has become a critical demand in human life. In the case of mission-critical (MC) scenarios, for instance, when natural disasters strike, providing ubiquitous connectivity becomes challenging by using traditional wireless networks. In this context, unmanned aerial vehicle (UAV) based aerial networks offer a promising alternative for fast, flexible, and reliable wireless communications. Due to unique characteristics such as mobility, flexible deployment, and rapid reconfiguration, drones can readily change location dynamically to provide on-demand communications to users on the ground in emergency scenarios. As a result, the usage of UAV base stations (UAV-BSs) has been considered an appropriate approach for providing rapid connection in MC scenarios. In this paper, we study how to control multiple UAV-BSs in both static and dynamic environments. We use a system-level simulator to model an MC scenario in which a macro-BS of a cellular network is out of service and multiple UAV-BSs are deployed using integrated access and backhaul (IAB) technology to provide coverage for users in the disaster area. With the data collected from the system-level simulation, a deep reinforcement learning algorithm is developed to jointly optimize the three-dimensional placement of these multiple UAV-BSs, which adapt their 3-D locations to the on-ground user movement. The evaluation results show that the proposed algorithm can support the autonomous navigation of the UAV-BSs to meet the MC service requirements in terms of user throughput and drop rate.Keywords
All Related Versions
Funding Information
- Chalmers AI Research Center and Software Center
This publication has 44 references indexed in Scilit:
- Deep reinforcement learning based trajectory optimization for UAV-enabled IoT with SWIPTAd Hoc Networks, 2024
- Deployable Networks for Public Safety in 5G and Beyond: A Coverage and Interference Study2021
- Challenges of real-world reinforcement learning: definitions, benchmarks and analysisMachine Learning, 2021
- UAV Control in Smart City Based on Space-Air-Ground Integrated Network2021
- Backhaul-Aware Optimization of UAV Base Station Location and Bandwidth Allocation for Profit MaximizationIEEE Access, 2020
- Challenges of Reinforcement Learning2020
- Deployment Algorithms of Flying Base Stations: 5G and Beyond With UAVsIEEE Internet of Things Journal, 2019
- Interference Management in UAV-Assisted Integrated Access and Backhaul Cellular NetworksIEEE Access, 2019
- Backhaul-aware robust 3D drone placement in 5G+ wireless networks2017
- Human-level control through deep reinforcement learningNature, 2015