Multiagent Best Routing in High-Mobility Digital-Twin-Driven Internet of Vehicles (IoV)
- 30 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (8) , 13708-13721
Abstract
Low-delay high-gain optimal multihop routing path is crucial to guarantee both the latency and reliability requirements for infotainment services in the high-mobility Internet of Vehicles (IoV) subject to queue stability. The high mobility in multihop IoV reduces reliability and energy efficiency, and becomes bottleneck for the optimal route solution using classical optimization methods. To a great extent, deep reinforcement learning (DRL)-based method is not applicable in IoV environment because of the continuously changing topology and space complexity, which grows exponentially with the number of state variables as well as the relaying hops. Usually, in multihop scenario, network reliability and latency are affected by mobility as well as average hop count, which limit the vehicle-to-vehicle (V2V) link connectivity. To cope with this problem, in this article, we formulate a minimum hop count delay-sensitive buffer-aided optimization problem in a dynamic complex multihop vehicular topology using a digital twin-enabled dynamic coordination graph (DCG). Particularly, for the first time, a DCG-based multiagent deep deterministic policy gradient (DCG-MADDPG) decentralized algorithm is proposed that combines the advantage of DCG and MADDPG to model continuously changing topology and find the optimal routing solutions by cooperative learning in the aforementioned communications. The proposed DCG-MADDPG coordinated learning trains each agent toward highly reliable and low-latency optimal decision-making path solutions while maintaining queue stability and convergence on the way to a desired state. Experimental results reveal that the proposed coordinated learning algorithm outperforms the existing learning in terms of energy consumption and latency at less computational complexity.Keywords
Funding Information
- Independent University, Bangladesh
This publication has 38 references indexed in Scilit:
- Fast Adaptive Task Offloading and Resource Allocation in Large-Scale MEC Systems via Multiagent Graph Reinforcement LearningIEEE Internet of Things Journal, 2023
- Deep-Reinforcement-Learning-Based Distributed Computation Offloading in Vehicular Edge Computing NetworksIEEE Internet of Things Journal, 2023
- Energy-Efficient Task Transfer in Wireless Computing Power NetworksIEEE Internet of Things Journal, 2022
- FLIRRAS: Fast Learning With Integrated Reward and Reduced Action Space for Online Multitask OffloadingIEEE Internet of Things Journal, 2022
- High-Reliability and Low-Energy Sensor Sharing in Vehicle Platoon Based on Multihop Millimeter-Wave CommunicationIEEE Internet of Things Journal, 2022
- Graph-Reinforcement-Learning-Based Task Offloading for Multiaccess Edge ComputingIEEE Internet of Things Journal, 2021
- Task Offloading and Resource Allocation for IoV Using 5G NR-V2X CommunicationIEEE Internet of Things Journal, 2021
- Novel Vehicular Compatibility-Based Ad Hoc Message Routing Scheme in the Internet of Vehicles Using Machine LearningIEEE Internet of Things Journal, 2021
- Multiagent Deep-Reinforcement-Learning-Based Resource Allocation for Heterogeneous QoS Guarantees for Vehicular NetworksIEEE Internet of Things Journal, 2021
- Reinforcement Learning2012