Multi-Agent Reinforcement Learning Based Idle-Aware Task Offloading in Dynamic Vehicular Networks With Partial Information
- 19 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 13, 3499-3515
Abstract
Edge computing provides low-latency computational services for task offloading in vehicular networks. However, challenges such as dynamic transmission rates, resource limitations, and information-sharing constraints impede efficient offloading. Few studies address these issues concurrently in designing dynamic offloading strategies, often resulting in sub-optimal system utility. This paper aims to achieve efficient vehicular task offloading via an idleness-aware edge server (ES) from a game theory perspective. We propose a Gated Recurrent Unit (GRU) prediction model with an attention mechanism to guide vehicles to the nearest idle ES. The offloading decision process is modeled as a stochastic game, proving the existence of a Nash equilibrium (NE). Additionally, we model it as a multi-agent partially observable Markov decision process (POMDP) to account for limited information access among vehicles. To solve the POMDP and achieve near-optimal NE, we introduce a Multi-Agent Reinforcement Learning-based Task Offloading (MATO) algorithm, combining a Differentiable Neural Computer (DNC) and an Advantageous Actor-Critic (A2C) framework. The DNC’s external memory stores structured representations of past information, enabling deeper exploration of the strategy space. Adjusting the reward representation enhances training efficiency. Experimental results driven by real-world datasets demonstrate that MATO effectively improves the computing offloading utility while increasing the convergence speed compared to existing schemes.Keywords
Funding Information
- Project of Science and Technology Commission of Shanghai (22511100800)
- Project of Science and Technology Commission of Shanghai (22511100503)
- National Natural Science Foundation of China (62293492)
This publication has 64 references indexed in Scilit:
- Joint computation offloading and resource allocation for end-edge collaboration in internet of vehicles via multi-agent reinforcement learningNeural Networks, 2024
- Adaptive Processing for Video Streaming with Energy Constraint: A Multi-Agent Reinforcement Learning Method2023
- TradeFL: A Trading Mechanism for Cross-Silo Federated Learning2023
- An Energy-efficient Computing Offloading Framework for Blockchain-enabled Video Streaming Systems2022
- JORA: Blockchain-based efficient joint computing offloading and resource allocation for edge video streaming systemsJournal of Systems Architecture, 2022
- FLASH: Federated Learning for Automated Selection of High-band mmWave Sectors2022
- Multi-user Edge-assisted Video Analytics Task Offloading Game based on Deep Reinforcement Learning2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020
- Dynamic Task Offloading in Multi-Agent Mobile Edge Computing Networks2019
- Hybrid computing using a neural network with dynamic external memoryNature, 2016