Enhanced DRL Strategy for Distributed Edge Computing in Vehicular Networks
- 26 August 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 39 (3) , 249-256
Abstract
The rapid growth of connected vehicles has posed significant challenges in managing computational offloading in vehicular networks. However, recent advancements in artificial intelligence, big data, and cloud computing have opened up new possibilities for optimizing computational offloading in vehicular edge computing (VEC) systems. This article addresses the critical and pressing issue of leveraging these new technologies to optimize the allocation of vehicular computational offloading resources at edge servers, with the aim of improving the efficiency of computational offloading services while reducing costs. We focus on the computational offloading problem in a distributed edge computing system, where computational tasks from vehicles can be processed by multiple edge computing resource units (ECRUs). To tackle this problem, we first model the optimization of computational offloading resources as a Markov Decision Process (MDP), taking into account system income, cost expenditure, and other relevant domains. We then propose an Enhanced Deep Q-Learning (EDQL) approach, which leverages reinforcement learning (RL) to solve the optimization problem effectively. Our simulation results demonstrate that the proposed EDQL approach achieves fast convergence speed, high convergence stability, and superior performance compared to existing methods.Keywords
This publication has 14 references indexed in Scilit:
- Joint Secure Offloading and Resource Allocation for Vehicular Edge Computing Network: A Multi-Agent Deep Reinforcement Learning ApproachIEEE Transactions on Intelligent Transportation Systems, 2023
- Joint Multi-Domain Resource Allocation and Trajectory Optimization in UAV-Assisted Maritime IoT NetworksIEEE Internet of Things Journal, 2022
- A Dynamic Resource Allocation Model Based on SMDP and DRL Algorithm for Truck Platoon in Vehicle NetworkIEEE Internet of Things Journal, 2021
- Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge ComputingIEEE Internet of Things Journal, 2021
- Computation Migration and Resource Allocation in Heterogeneous Vehicular Networks: A Deep Reinforcement Learning ApproachIEEE Access, 2020
- Three Dynamic Pricing Schemes for Resource Allocation of Edge Computing for IoT EnvironmentIEEE Internet of Things Journal, 2020
- A Cyclic Game for Joint Cooperation and Competition of Edge Resource Allocation2019
- iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT NetworksIEEE Internet of Things Journal, 2019
- An Envy-Free Auction Mechanism for Resource Allocation in Edge Computing Systems2018
- Joint Admission Control and Resource Allocation in Edge Computing for Internet of ThingsIEEE Network, 2018