Revenue and Energy Efficiency-Driven Delay-Constrained Computing Task Offloading and Resource Allocation in a Vehicular Edge Computing Network: A Deep Reinforcement Learning Approach
- 29 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (11) , 8852-8868
Abstract
For in-vehicle application, task type and vehicle state information, i.e., vehicle speed, bear a significant impact on the task delay requirement. However, the joint impact of task type and vehicle speed on the task delay constraint has not been studied, and this lack of study may cause a mismatch between the requirement of the task delay and allocated computation and wireless resources. In this article, we propose a joint task type and vehicle speed-aware task offloading and resource allocation strategy to decrease the vehicle’s energy cost for executing tasks and increase the revenue of the vehicle for processing tasks within the delay constraint. First, we establish the joint task type and vehicle speed-aware delay constraint model. Then, the delay, energy cost, and revenue for task execution in the vehicular edge computing (VEC) server, local terminal, and terminals of other vehicles are calculated. Based on the energy cost and revenue from task execution, the utility function of the vehicle is acquired. Next, we formulate a joint optimization of task offloading and resource allocation to maximize the utility level of the vehicles subject to the constraints of task delay, computation resources, and wireless resources. To obtain a near-optimal solution of the formulated problem, a joint offloading and resource allocation based on the multiagent deep deterministic policy gradient (JORA-MADDPG) algorithm is proposed to maximize the utility level of vehicles. Simulation results show that our algorithm can achieve superior performance in task completion delay, vehicles’ energy cost, and processing revenue.Keywords
All Related Versions
Funding Information
- National Science Foundation of China (U1903213, 61701389)
- Shaanxi Key Research and Development Program (2018ZDCXL-GY-04-03-02)
- Xi’an Science and Technology Funds (GX2022)
- China Postdoctoral Science Foundation (2021M692587)
This publication has 35 references indexed in Scilit:
- Smart Cities: A Survey on Data Management, Security, and Enabling TechnologiesIEEE Communications Surveys & Tutorials, 2017
- AVE: Autonomous Vehicular Edge Computing Framework with ACO-Based SchedulingIEEE Transactions on Vehicular Technology, 2017
- Optimal delay constrained offloading for vehicular edge computing networks2017
- Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency ScalingIEEE Transactions on Communications, 2017
- Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-LoadingIEEE Vehicular Technology Magazine, 2017
- Delay constrained offloading for Mobile Edge Computing in cloud-enabled vehicular networks2016
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Power Control in D2D-Based Vehicular Communication NetworksIEEE Transactions on Vehicular Technology, 2015
- Statistical Methods for Research Workers1992
- Tables of Normal Percentile PointsJournal of the American Statistical Association, 1970