Parallel Task Offloading and Trajectory Optimization for UAV-Assisted Mobile Edge Computing via Hierarchical Reinforcement Learning
Open Access
Abstract
With the rapid growth of IoT data and increasing demands for low-latency computation, UAV-assisted mobile edge computing (MEC) offers a flexible solution to overcome the limitations of fixed MEC servers. To better reflect concurrent service scenarios, this paper innovatively develops a multi-channel task modeling method, enabling UAVs to simultaneously select multiple users and offload tasks via separate channels, thereby breaking the constraints of traditional sequential assumptions. To address task conflicts and resource waste caused by sequential service assumptions, this paper proposes a hierarchical reinforcement learning-based trajectory and offloading decision-making framework (H-TAOD) for UAVs with multi-channel parallel processing. The framework decouples UAV trajectory planning and task offloading into two sub-tasks optimized via appropriate reinforcement learning methods. An invalid action masking (IAM) mechanism is introduced to avoid channel conflicts. Simulation results verify the superiority of H-TAOD in reward, delay, and convergence.Keywords
Funding Information
- National Natural Science Foundation of China (62263025)
This publication has 31 references indexed in Scilit:
- Modeling and investigation on the performance enhancement of hovering UAV-based FSO relay optical wireless communication systems under pointing errors and atmospheric turbulence effectsOptical and Quantum Electronics, 2023
- A comprehensive survey on reinforcement-learning-based computation offloading techniques in Edge Computing SystemsJournal of Network and Computer Applications, 2023
- Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning ApproachIEEE Internet of Things Journal, 2021
- Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approachWireless Networks, 2021
- Enabling Efficient Scheduling in Large-Scale UAV-Assisted Mobile-Edge Computing via Hierarchical Reinforcement LearningIEEE Internet of Things Journal, 2021
- Hierarchical Deep Reinforcement Learning for Backscattering Data Collection With Multiple UAVsIEEE Internet of Things Journal, 2020
- Drone-Cell Trajectory Planning and Resource Allocation for Highly Mobile Networks: A Hierarchical DRL ApproachIEEE Internet of Things Journal, 2020
- Toward Big Data Processing in IoT: Path Planning and Resource Management of UAV Base Stations in Mobile-Edge Computing SystemIEEE Internet of Things Journal, 2019
- Hierarchical Game-Theoretic and Reinforcement Learning Framework for Computational Offloading in UAV-Enabled Mobile Edge Computing Networks With Multiple Service ProvidersIEEE Internet of Things Journal, 2019
- Stochastic Computation Offloading and Trajectory Scheduling for UAV-Assisted Mobile Edge ComputingIEEE Internet of Things Journal, 2018