O-RAN-Based Digital Twin Function Virtualization for Sustainable IoV Service Response: An Asynchronous Hierarchical Reinforcement Learning Approach
- 29 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Green Communications and Networking
- Vol. 8 (3) , 1049-1060
Abstract
Digital Twin for Vehicular Networks (DTVN) continuously simulates and optimizes vehicle behaviors to support emerging 6G Internet-of-Vehicle (IoV) applications such as DT-assisted autonomous driving. To meet Quality of Service (QoS), resource scheduling for distributed vehicle DTs is carried out. However, existing works mainly respond to service demand based on one-to-one DT synchronization and computation offloading, which limits the service response quality and is not sustainable. Meanwhile, twin objects need to be frequently transferred at edges in parallel with the moving vehicles, the IoV service demand response under high-dynamic DT resource distribution is challenging. In this paper, a novel digital twin function virtualization (DTFV) architecture based on Open Radio Access Networks (O-RAN) is proposed. In DTFV, multiple vehicle DTs following one-to-one synchronization are decoupled and reorganized as a Virtualized Digital Twin (VDT) following dissemination-based synchronization for dynamic service response, without needs for offloading service to additional edge devices. Besides, to optimize the overall IoV service response profit, we propose an asynchronous hierarchical reinforcement learning (AHRL)-based DTFV resource scheduling scheme to find optimal VDT orchestration and synchronization strategies. Finally, experimental results show our scheme achieves 8.48% higher service response profit and 6.8% lower VDT synchronization delay over the best baseline scheme.Keywords
Funding Information
- National Natural Science Foundation of China (U21B2019)
This publication has 26 references indexed in Scilit:
- Digital Twin and DRL-Driven Semantic Dissemination for 6G Autonomous Driving Service2023
- RADiT: Resource Allocation in Digital Twin-Driven UAV-Aided Internet of Vehicle NetworksIEEE Journal on Selected Areas in Communications, 2023
- Digital Twin-Assisted URLLC-Enabled Task Offloading in Mobile Edge Network via Robust Combinatorial OptimizationIEEE Journal on Selected Areas in Communications, 2023
- A Survey on Digital Twin for Industrial Internet of Things: Applications, Technologies and ToolsIEEE Communications Surveys & Tutorials, 2023
- Data Synchronization for Vehicular Digital Twin Network2022
- Jaebot: Discord Bot for Network Analysis with NetworkX2022
- Proximal Policy Optimization-Based Transmit Beamforming and Phase-Shift Design in an IRS-Aided ISAC System for the THz BandIEEE Journal on Selected Areas in Communications, 2022
- Digital Twin as a Service (DTaaS) in Industry 4.0: An Architecture Reference ModelAdvanced Engineering Informatics, 2021
- Efficient Hybrid Data Dissemination for Edge-Assisted Automated DrivingIEEE Internet of Things Journal, 2019
- Policy-Gradient Based Actor-Critic Algorithms2009