Multi-Agent DRL-Based Hungarian Algorithm (MADRLHA) for Task Offloading in Multi-Access Edge Computing Internet of Vehicles (IoVs)
- 23 March 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 21 (9) , 7641-7652
Abstract
This paper investigates the computation offloading problem in a high mobility internet of vehicles (IoVs) environment, aiming to guarantee latency, energy consumption, and payment cost requirements. Both moving and parked vehicles are utilized as fog nodes. Vehicles in high mobility environments need collaborative interactions in a decentralized manner for better network performances, where agent action space grows exponentially with the number of vehicles. The vehicular mobility introduces additional dynamicity in the network, and the learning agent requires a joint cooperative behavior for establishing convergence. The traditional deep reinforcement learning (DRL)-based offloading in IoV ignores other agent’s actions during the training process as an independent learner, which makes a lack of robustness against the high mobility environment. To overcome it, we develop a cooperative three-layer, more generic decentralized vehicle-assisted multi-access edge computing (VMEC) network, where vehicles in associated RSU and neighbor RSUs are in the bottom fog layer, MEC servers are in the middle cloudlet layer, and cloud in the top layer. Then multi-agent DRL-based Hungarian algorithm (MADRLHA) in the bipartite graph maximum matching problem is applied to solve dynamic task offloading in VMEC. Extensive experimental results and comprehensive comparisons are conducted to illustrate the superiority of our proposed method.Keywords
Funding Information
- University of Sydney
This publication has 35 references indexed in Scilit:
- Mobility-Aware Multi-User Offloading Optimization for Mobile Edge ComputingIEEE Transactions on Vehicular Technology, 2020
- Deep-Reinforcement-Learning-Based Mode Selection and Resource Allocation for Cellular V2X CommunicationsIEEE Internet of Things Journal, 2019
- Delay-Sensitive Task Offloading in the 802.11p-Based Vehicular Fog Computing SystemsIEEE Internet of Things Journal, 2019
- Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement LearningIEEE Journal on Selected Areas in Communications, 2019
- Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing NetworksIEEE Transactions on Mobile Computing, 2019
- Deep Reinforcement Learning for Intelligent Internet of Vehicles: An Energy-Efficient Computational Offloading SchemeIEEE Transactions on Cognitive Communications and Networking, 2019
- Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and ChallengesIEEE Vehicular Technology Magazine, 2019
- Folo: Latency and Quality Optimized Task Allocation in Vehicular Fog ComputingIEEE Internet of Things Journal, 2018
- Offloading in Mobile Cloudlet Systems with Intermittent ConnectivityIEEE Transactions on Mobile Computing, 2015
- Approximations for the delay probability in the M/G/s queueMathematical and Computer Modelling, 1995