AIGC-Driven Real-Time Interactive 4-D Traffic Scene Generation in Vehicular Networks
- 25 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 39 (6) , 261-269
Abstract
Real-time, interactive 4D traffic scene generation enables rapid digital twinning of traffic scenarios, improving management and decision-making in intelligent transportation systems. However, current text-to-video models, such as Sora, struggle to maintain the temporal coherence of traffic elements and interact with dynamic environments and users when generating 4D scenes. This article introduces a novel cloud-edge-terminal collaborative framework that leverages Artificial Intelligence-Generated Content (AIGC) in vehicular networks to tackle these challenges, ensuring long-term coherence and improved interactivity. The framework presents a comprehensive architecture for real-time interactive 4D scene generation, encompassing data collection, management, model pre-training, fine-tuning, and inference. We examine key design requirements and challenges, demonstrating that our microservice-based framework enables the system to generate and update 4D traffic scenes in real time, effectively responding to traffic data and user inputs. To the best of our knowledge, this is the first successful implementation of real-time, interactive 4D traffic scene generation. Performance evaluations show the superiority of our framework, powered by microservice-based code fine-tuning, over traditional frameworks. Finally, we discuss future research directions to enhance AIGC-driven 4D traffic scene generation.Keywords
This publication has 11 references indexed in Scilit:
- FLeS: A Federated Learning-Enhanced Semantic Communication Framework for Mobile AIGC-Driven Human Digital TwinsIEEE Network, 2025
- End-to-End Multitarget Flexible Job Shop Scheduling With Deep Reinforcement LearningIEEE Internet of Things Journal, 2024
- Cloud-Edge-Terminal Collaborative AIGC for Autonomous DrivingIEEE Wireless Communications, 2024
- KI-GAN: Knowledge-Informed Generative Adversarial Networks for Enhanced Multi-Vehicle Trajectory Forecasting at Signalized Intersections2024
- A Unified Approach for Text-and Image-Guided 4D Scene Generation2024
- TR2MTL: LLM based framework for Metric Temporal Logic Formalization of Traffic Rules2024
- A Revolution of Personalized Healthcare: Enabling Human Digital Twin With Mobile AIGCIEEE Network, 2024
- Networking Architecture and Key Supporting Technologies for Human Digital Twin in Personalized Healthcare: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2024
- Flow Supervision for Deformable NeRF2023
- Unsupervised Traffic Scene Generation with Synthetic 3D Scene Graphs2021