5G Network on Wings: A Deep Reinforcement Learning Approach to the UAV-based Integrated Access and Backhaul
Authors:
Preprint
Abstract
Fast and reliable wireless communication has become a critical demand in human life. In the case of mission-critical (MC) scenarios, for instance, when natural disasters strike, providing ubiquitous connectivity becomes challenging by using traditional wireless networks. In this context, unmanned aerial vehicle (UAV) based aerial networks offer a promising alternative for fast, flexible, and reliable wireless communications. Due to unique characteristics such as mobility, flexible deployment, and rapid reconfiguration, drones can readily change location dynamically to provide on-demand communications to users on the ground in emergency scenarios. As a result, the usage of UAV base stations (UAV-BSs) has been considered an appropriate approach for providing rapid connection in MC scenarios. In this paper, we study how to control multiple UAV-BSs in both static and dynamic environments. We use a system-level simulator to model an MC scenario in which a macro BS of a cellular network is out of service and multiple UAV-BSs are deployed using integrated access and backhaul (IAB) technology to provide coverage for users in the disaster area. With the data collected from the system-level simulation, a deep reinforcement learning algorithm is developed to jointly optimize the three-dimensional placement of these multiple UAV-BSs, which adapt their 3-D locations to the on-ground user movement. The evaluation results show that the proposed algorithm can support the autonomous navigation of the UAV-BSs to meet the MC service requirements in terms of user throughput and drop rate.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Autonomous Navigation and Configuration of Integrated Access Backhauling for UAV Base Station Using Reinforcement Learning2022
- Deployable Networks for Public Safety in 5G and Beyond: A Coverage and Interference Study2021
- Resource Allocation and Trajectory Design in UAV-Aided Cellular Networks Based on Multiagent Reinforcement LearningIEEE Internet of Things Journal, 2021
- Privacy-Preserving Federated Learning for UAV-Enabled Networks: Learning-Based Joint Scheduling and Resource ManagementIEEE Journal on Selected Areas in Communications, 2021
- Backhaul-Aware Optimization of UAV Base Station Location and Bandwidth Allocation for Profit MaximizationIEEE Access, 2020
- Optimal UAV Caching and Trajectory in Aerial-Assisted Vehicular Networks: A Learning-Based ApproachIEEE Journal on Selected Areas in Communications, 2020
- Deep Reinforcement Learning for Dynamic Uplink/Downlink Resource Allocation in High Mobility 5G HetNetIEEE Journal on Selected Areas in Communications, 2020
- Deployment Algorithms of Flying Base Stations: 5G and Beyond With UAVsIEEE Internet of Things Journal, 2019
- Interference Management in UAV-Assisted Integrated Access and Backhaul Cellular NetworksIEEE Access, 2019
- Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning ApproachIEEE Journal on Selected Areas in Communications, 2018