UAV-Assisted MEC System With Mobile Ground Terminals: DRL-Based Joint Terminal Scheduling and UAV 3D Trajectory Design
Top Cited Papers
- 27 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (7) , 10164-10180
Abstract
Inthis paper, we investigate an unmanned aerial vehicle (UAV)-assisted edge computing network in a sophisticated three-dimensional (3D) scenario, e.g., a post-disaster urban area with multiple mobile ground terminals (GTs) for resilience. The mission of the UAV is to first collect a set of computation tasks from multiple GT sources, then process them and make joint decisions (computation results) which are finally transmitted to another set of GT destinations. An efficient design is provided aiming at minimizing the total time cost including costs for the task offloading, computations, and decision transmissions, via jointly designing the UAV's trajectory and the scheduling of communications from and to different GTs. In particular, we take into account the practical assumptions on the GTs' mobility, on the obstacle avoidance to 3D buildings, and on that the UAV is possible to fly among buildings, i.e., the flying altitude can be lower than the buildings' heights. To address the established complex and non-convex problem, we first provide a problem transformation by exploiting Markov decision process (MDP), and then propose a deep reinforcement learning (DRL) approach-based solution with a multi-step dueling DDQN (D3QN) method. As a result, an efficient solution is achieved, where the UAV acts as the agent to continuously explore and improve its mobile strategy during interacting with the environment under the proposed method. The simulation results show the advantages of the proposed 3D trajectory design in comparison to a 2D one. In addition, the results confirm the robustness of the proposed design in terms of different GTs' mobility models and UAV flying height/area limits, and illustrate the superiority of unrestricted feasible domains for the UAV flight.Keywords
Funding Information
- National Natural Science Foundation of China (62101389)
- National Key Research and Development Program of China (2023YFE0206600)
- Federal Ministry of Education and Research of Germany (16KISK012)
- National Natural Science Foundation of China (62261035)
- National Natural Science Foundation of China (62061027)
This publication has 38 references indexed in Scilit:
- Computation Throughput Maximization for UAV-Enabled MEC with Binary Computation Offloading2022
- Joint Trajectory Design and BS Association for Cellular-Connected UAV: An Imitation-Augmented Deep Reinforcement Learning ApproachIEEE Internet of Things Journal, 2021
- Joint Trajectory-Task-Cache Optimization With Phase-Shift Design of RIS-Assisted UAV for MECIEEE Wireless Communications Letters, 2021
- Multi-UAV Deployment for MEC Enhanced IoT Networks2020
- Reflections in the Sky: Millimeter Wave Communication with UAV-Carried Intelligent Reflectors2019
- Joint Trajectory-Task-Cache Optimization in UAV-Enabled Mobile Edge Networks for Cyber-Physical SystemIEEE Access, 2019
- A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open ProblemsIEEE Communications Surveys & Tutorials, 2019
- Fundamental Trade-offs in Communication and Trajectory Design for UAV-Enabled Wireless NetworkIEEE Wireless Communications, 2019
- Task Offloading in UAV-Aided Edge Computing: Bit Allocation and Trajectory OptimizationIEEE Communications Letters, 2019
- Throughput Maximization for UAV-Enabled Wireless Powered Communication NetworksIEEE Internet of Things Journal, 2018