Deep Reinforcement Learning Approach for UAV-Assisted Mobile Edge Computing Networks
Authors:
- 4 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3839-3844
Abstract
This paper studies a deep reinforcement learning (DRL) approach for the unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) networks where a UAV-mounted server offloads computation tasks of mobile users (MUs). We aim at minimizing the energy consumption of the MUs by adjusting UAV mobility, UAV-MU association, computation resource allocation, and task offloading rules. This requires an online and joint optimization of different types of variables constructing heterogeneous solution spaces. To realize real-time optimization strategies, we propose an online DRL method based on the twin-delayed deep deterministic policy gradient (TD3) framework. The joint optimization of heterogeneous action variables is tackled by a novel actor neural network that partitions the high-dimensional action set into several solution spaces. In addition, the proposed TD3 framework achieves adaptability to new task offloading requests through our proposed training and execution strategy. Numerical results verify the effectiveness of the proposed DRL architecture over benchmark schemes.Keywords
Funding Information
- National Research Foundation of Korea
This publication has 18 references indexed in Scilit:
- UAV-Aided Secure Communications With Cooperative JammingIEEE Transactions on Vehicular Technology, 2018
- Mobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things CommunicationsIEEE Transactions on Wireless Communications, 2017
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Mobile Edge Computing via a UAV-Mounted Cloudlet: Optimization of Bit Allocation and Path PlanningIEEE Transactions on Vehicular Technology, 2017
- Low-Altitude Unmanned Aerial Vehicles-Based Internet of Things Services: Comprehensive Survey and Future PerspectivesIEEE Internet of Things Journal, 2016
- Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage ScalingIEEE Transactions on Communications, 2016
- Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and TradeoffsIEEE Transactions on Wireless Communications, 2016
- Mobility Models, Traces and Impact of Mobility on Opportunistic Routing Algorithms: A SurveyIEEE Communications Surveys & Tutorials, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Optimal LAP Altitude for Maximum CoverageIEEE Wireless Communications Letters, 2014