Deep-Reinforcement-Learning-Based Distributed Computation Offloading in Vehicular Edge Computing Networks
Top Cited Papers
- 22 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (14) , 12416-12433
Abstract
Vehicular edge computing has emerged as a promising paradigm by offloading computation-intensive latency-sensitive tasks to mobile-edge computing (MEC) servers. However, it is difficult to provide users with excellent Quality-of-Service (QoS) by relying only on these server resources. Therefore, in this article, we propose to formulate the computation offloading policy based on deep reinforcement learning (DRL) in a vehicle-assisted vehicular edge computing network (VAEN) where idle resources of vehicles are deemed as edge resources. Specifically, each task is represented by a directed acyclic graph (DAG) and offloaded to edge nodes according to our proposed subtask scheduling priority algorithm. Further, we formalize the computation offloading problem under the constraints of candidate service vehicle models, which aims to minimize the long-term system cost, including delay and energy consumption. To this end, we propose a distributed computation offloading algorithm based on multiagent DRL (DCOM), where an improved actor–critic network (IACN) is devised to extract features, and a joint mechanism of prioritized experience replay and adaptive $n$ -step learning (JMPA) is proposed to enhance learning efficiency. The numerical simulations demonstrate that, in VAEN scenario, DCOM achieves significant decrements in the latency and energy consumption compared with other advanced benchmark algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (61901015)
This publication has 48 references indexed in Scilit:
- Learning-Based Privacy-Aware Offloading for Healthcare IoT With Energy HarvestingIEEE Internet of Things Journal, 2018
- Dynamic Computation Offloading for Mobile Cloud Computing: A Stochastic Game-Theoretic ApproachIEEE Transactions on Mobile Computing, 2018
- Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation OffloadingIEEE Transactions on Wireless Communications, 2018
- A novel DDPG method with prioritized experience replay2017
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Multiuser Resource Allocation for Mobile-Edge Computation Offloading2017
- Power-Delay Tradeoff in Multi-User Mobile-Edge Computing Systems2016
- Energy-Efficient Resource Allocation for Mobile-Edge Computation OffloadingIEEE Transactions on Wireless Communications, 2016
- Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting DevicesIEEE Journal on Selected Areas in Communications, 2016
- Efficient Multi-User Computation Offloading for Mobile-Edge Cloud ComputingIEEE/ACM Transactions on Networking, 2015