World Model-Based Learning for Long-Term Age of Information Minimization in Vehicular Networks
Authors:
- 8 December 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 6202-6207
Abstract
Traditional reinforcement learning (RL)-based learning approaches for wireless networks rely on expensive trial-and-error mechanisms and real-time feedback based on extensive environment interactions, which leads to low data efficiency and short-sighted policies. These limitations become particularly problematic in complex, dynamic networks with high uncertainty and long-term planning requirements. To address these limitations, in this paper, a novel world model-based learning framework is proposed to minimize packet-completeness-aware age of information (CAoI) in a vehicular network. Particularly, a challenging representative scenario is considered pertaining to a millimeter-wave (mmWave) vehicle-to-everything (V2X) communication network, which is characterized by high mobility, frequent signal blockages, and extremely short coherence time. Then, a world model framework is proposed to jointly learn a dynamic model of the mmWave V2X environment and use it to imagine trajectories for learning how to perform link scheduling. In particular, the long-term policy is learned in differentiable imagined trajectories instead of environment interactions. Moreover, owing to its imagination abilities, the world model can jointly predict time-varying wireless data and optimize link scheduling in real-world wireless and V2X networks. Thus, during intervals without actual observations, the world model remains capable of making efficient decisions. Extensive experiments are performed on a realistic simulator based on Sionna that integrates physics-based end-to-end channel modeling, ray-tracing, and scene geometries with material properties. Simulation results show that the proposed world model achieves a significant improvement in data efficiency, and achieves 26% improvement and 16% improvement in CAoI, respectively, compared to the model-based RL (MBRL) method and the model-free RL (MFRL) method.Keywords
All Related Versions
Funding Information
- National Science Foundation
This publication has 10 references indexed in Scilit:
- Artificial General Intelligence (AGI)-Native Wireless Systems: A Journey Beyond 6GProceedings of the IEEE, 2025
- Fast Geometric Learning of MIMO Signal Detection over Grassmannian Manifolds2024
- Adaptive Resource Allocation for Semantic Communication NetworksIEEE Transactions on Communications, 2024
- Model-Based Deep Reinforcement Learning Framework for Channel Access in Wireless NetworksIEEE Internet of Things Journal, 2023
- Reinforcement Learning-Based Joint User Scheduling and Link Configuration in Millimeter-Wave NetworksIEEE Transactions on Wireless Communications, 2022
- Model-Based Reinforcement Learning With Kernels for Resource Allocation in RAN SlicesIEEE Transactions on Wireless Communications, 2022
- Vehicular Blockage Modelling and Performance Analysis for mmWave V2V Communications2022
- Fast MIMO Beamforming via Deep Reinforcement Learning for High Mobility mmWave ConnectivityIEEE Journal on Selected Areas in Communications, 2021
- Mitigating the Impact of Blockages in Millimeter-Wave Vehicular Networks Through Vehicular RelaysIEEE Open Journal of Intelligent Transportation Systems, 2021
- A Model-Driven Deep Reinforcement Learning Heuristic Algorithm for Resource Allocation in Ultra-Dense Cellular NetworksIEEE Transactions on Vehicular Technology, 2019