Deep Reinforcement Learning-Based Computation Offloading in UAV Swarm-Enabled Edge Computing for Surveillance Applications
Open Access
- 6 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 68269-68285
Abstract
The rapid development of the Internet of Things and wireless communication has resulted in the emergence of many latency-constrained and computation-intensive applications such as surveillance, virtual reality, and disaster monitoring. To satisfy the computational demand and reduce the prolonged transmission delay to the cloud, mobile edge computing (MEC) has evolved as a potential candidate that can improve task completion efficiency in a reliable fashion. Owing to its high mobile nature and ease of use, as promising candidates, unmanned aerial vehicles (UAVs) can be incorporated with MEC to support such computation-intensive and latency-critical applications. However, determining the ideal offloading decision for the UAV on basis of the task characteristics still remains a crucial challenge. In this paper, we investigate a surveillance application scenario of a hierarchical UAV swarm that includes an UAV-enabled MEC with a team of UAVs surveilling the area to be monitored. To determine the optimal offloading policy, we propose a deep reinforcement learning based computation offloading (DRLCO) scheme using double deep Q-learning, which minimizes the weighted sum cost by jointly considering task execution delay and energy consumption. A performance study shows that the proposed DRLCO technique significantly outperforms conventional schemes in terms of offloading cost, energy consumption, and task execution delay. The better convergence and effectiveness of the proposed method over conventional schemes are also demonstrated.Keywords
Funding Information
- National Research Foundation of Korea (NRF) Grant through the Korean Government [Ministry of Science and ICT (MSIT)] (NRF-2022R1A2C1009037)
This publication has 49 references indexed in Scilit:
- Stochastic Computation Offloading and Scheduling Based on Mobile Edge ComputingIEEE Access, 2019
- Interference-Aware Online Distributed Channel Selection for Multicluster FANET: A Potential Game ApproachIEEE Transactions on Vehicular Technology, 2019
- Multivessel Computation Offloading in Maritime Mobile Edge Computing NetworkIEEE Internet of Things Journal, 2018
- QTCP: Adaptive Congestion Control with Reinforcement LearningIEEE Transactions on Network Science and Engineering, 2018
- Computation offloading game for an UAV network in mobile edge computing2017
- Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency ScalingIEEE Transactions on Communications, 2017
- Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting DevicesIEEE Journal on Selected Areas in Communications, 2016
- Energy-efficient dynamic offloading and resource scheduling in mobile cloud computing2016
- A Dynamic Offloading Algorithm for Mobile ComputingIEEE Transactions on Wireless Communications, 2012
- Saving portable computer battery power through remote process executionACM SIGMOBILE Mobile Computing and Communications Review, 1998