Joint Task Migration and Resource Allocation in Vehicular Edge Computing: A Deep Reinforcement Learning-Based Approach
- 5 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (6) , 9476-9490
Abstract
With the rise of the Internet of Vehicles (IoV), a growing number of in-vehicle applications have been developed, significantly enhancing the driving experience, while simultaneously imposing excessive higher demands on computing resources. Vehicle Edge Computing (VEC) emerges as a promising solution by offloading computational tasks to edge servers positioned near vehicles. However, the limited computing capacity of these edge servers necessitates the efficient allocation of resources to adequately meet the demands of all vehicles. In this paper, we introduce a multi-vehicle VEC offloading framework that considers both the execution time of tasks and the costs incurred when utilizing edge server resources and transmitting tasks between Roadside Units (RSUs). Building on this framework, we design an optimization problem to minimize the average weighted cost, modeled as a Markov Decision Process (MDP). To address this, we propose a DDPG-based Resource Allocation and Offloading Decision Algorithm (DRAODA). This algorithm enables the control center to generate resource allocation strategies while allowing individual vehicles to make task offloading decisions independently, based solely on their own data and the edge server's status, without relying on information from other vehicles. Additionally, we propose an Optimal Task Offloading Destination Selection Algorithm (OTODSA) to further minimize the average weighted cost, enhancing the overall efficiency and effectiveness of the resource allocation process.Keywords
Funding Information
- National Natural Science Foundation of China (62101463)
- National Natural Science Foundation of China (62361136810)
- Sichuan Science and Technology Program (2025ZNSFSC0505)
- Open Research Project of Xidian University (ISN24-09)
- Key Research and Development Program of Sichuan (2023ZHCG0010)
- Key Research and Development Program of Sichuan (2023YFH0012)
- Spring Sunshine Plan Cooperative Research Project of Ministry of Education (HZKY20220557)
- Fundamental Research Funds for the Central Universities (XJ2024002002)
- National Natural Science Foundation of China (62202140)
- Natural Science Foundation of Jiangsu Province of China (BK20220974)
- NSFC project (62171352)
- NSFC project (62020106001)
- NSFC project (62171352)
This publication has 52 references indexed in Scilit:
- A bandwidth-fair migration-enabled task offloading for vehicular edge computing: a deep reinforcement learning approachCCF Transactions on Pervasive Computing and Interaction, 2024
- Task offloading and resource allocation algorithm based on deep reinforcement learning for distributed AI execution tasks in IoT edge computing environmentsComputer Networks, 2023
- Intelligent task migration with deep Qlearning in multi‐access edge computingIET Communications, 2021
- Multi-edge collaborative offloading and energy threshold-based task migration in mobile edge computing environmentWireless Networks, 2021
- Computation Migration and Resource Allocation in Heterogeneous Vehicular Networks: A Deep Reinforcement Learning ApproachIEEE Access, 2020
- Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based SchemeMobile Networks and Applications, 2020
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- An energy-aware computation offloading method for smart edge computing in wireless metropolitan area networksJournal of Network and Computer Applications, 2019
- Efficient Mobility-Aware Task Offloading for Vehicular Edge Computing NetworksIEEE Access, 2019
- Mobile cloud computing: Challenges and future research directionsJournal of Network and Computer Applications, 2018