TSTNet: Temporal Semantic Transformer-Based Computing Power Network for Automatic Driving in the Internet of Vehicles
- 1 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Artificial Intelligence
- Vol. 6 (10) , 2669-2684
Abstract
Automatic driving systems face critical challenges, including limited computational resources, complex data processing demands, and disruptions caused by high vehicular mobility, all of which hinder real-time decision-making and system accuracy. Existing solutions, such as edge computing and distributed architectures, partially address these issues but often fail to integrate semantic communication and mobility-aware optimizations. To tackle these challenges, we propose a Temporal Semantic Transformer-based edge computing network architecture (TSTNet) that enhances decision-making accuracy and reduces latency in automatic driving systems. TSTNet overcomes three key challenges in automatic driving. First, it efficiently utilizes limited computational resources by optimizing the processing of large-scale multimodal data through lightweight semantic extractors and attention-based feature integration, significantly reducing computational overhead. Second, it preserves semantic and behavioral continuity by ensuring seamless transitions of vehicle behavior and surrounding scene semantics during mobility and service handovers. This ensures consistent situational awareness even in highly dynamic vehicular environments. Third, TSTNet reduces decision-making latency by leveraging semantic inheritance to minimize redundant computations, enabling real-time performance and improving the reliability of driver-assist systems. Experimental results demonstrate that TSTNet improves task accuracy by over 90% while reducing decision-making latency by over 50% compared to conventional methods. This architecture offers a scalable, efficient, and robust solution to the computational and mobility challenges in automatic driving, enabling enhanced real-time adaptability in complex traffic scenarios.Keywords
This publication has 43 references indexed in Scilit:
- PAINet: An Integrated Passive and Active Intent Network for Digital Twins in Automatic DrivingIEEE Communications Magazine, 2024
- Efficient IoV Resource Management Through Enhanced Clustering, Matching, and Offloading in DT-Enabled Edge ComputingIEEE Internet of Things Journal, 2024
- YOLO-Based Semantic Communication With Generative AI-Aided Resource Allocation for Digital Twins ConstructionIEEE Internet of Things Journal, 2023
- Improved Nonlinear Transform Source-Channel Coding to Catalyze Semantic CommunicationsIEEE Journal of Selected Topics in Signal Processing, 2023
- A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving ServicesIEEE Communications Surveys & Tutorials, 2023
- Toward Adaptive Semantic Communications: Efficient Data Transmission via Online Learned Nonlinear Transform Source-Channel CodingIEEE Journal on Selected Areas in Communications, 2023
- Unmanned-Surface-Vehicle-Aided Maritime Data Collection Using Deep Reinforcement LearningIEEE Internet of Things Journal, 2022
- A Lite Distributed Semantic Communication System for Internet of ThingsIEEE Journal on Selected Areas in Communications, 2020
- Research Challenges and Security Threats to AI-Driven 5G Virtual Emotion Applications Using Autonomous Vehicles, Drones, and Smart DevicesIEEE Network, 2020
- LiDAR-Video Driving Dataset: Learning Driving Policies Effectively2018