Adaptive Inference Reinforcement Learning for Task Offloading in Vehicular Edge Computing Systems
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Vehicular edge computing (VEC) is expected as a promising technology to improve the quality of innovative applications in vehicular networks through computation offloading. However, in VEC system, the characteristics of distributed computing resources and high mobility of vehicles bring a critical challenge, i.e., whether to execute computation task locally or in edge servers can obtain the least computation overhead. In this paper, we study the VEC system for a representative vehicle with multiple dependent tasks that need to be processed successively, where nearby vehicles with computing servers can be selected for offloading. Considering the migration cost incurred during position shift procedure, a sequential decision making problem is formulated to minimize the overall costs of delay and energy consumption. To tackle it effectively, we propose a deep Q network algorithm by introducing Bayesian inference taking advantage of priori distribution and statistical information, which adapts to the environmental dynamics in a smarter manner. Numerical results demonstrate our proposed learning-based algorithm achieve a significant improvement in overall cost of task execution compared with other baseline policies.Keywords
This publication has 20 references indexed in Scilit:
- Follow Me at the Edge: Mobility-Aware Dynamic Service Placement for Mobile Edge ComputingIEEE Journal on Selected Areas in Communications, 2018
- Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement LearningIEEE Transactions on Vehicular Technology, 2018
- Machine Learning for Vehicular Networks: Recent Advances and Application ExamplesIEEE Vehicular Technology Magazine, 2018
- Graph-Based Resource Sharing in Vehicular CommunicationIEEE Transactions on Wireless Communications, 2018
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Mobility-Aware Coded Probabilistic Caching Scheme for MEC-Enabled Small Cell NetworksIEEE Access, 2017
- Optimal delay constrained offloading for vehicular edge computing networks2017
- Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency ScalingIEEE Transactions on Communications, 2017
- Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-LoadingIEEE Vehicular Technology Magazine, 2017
- Vehicular Fog Computing: A Viewpoint of Vehicles as the InfrastructuresIEEE Transactions on Vehicular Technology, 2016