VistaGPT: Generative Parallel Transformers for Vehicles With Intelligent Systems for Transport Automation
Top Cited Papers
- 23 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 8 (9) , 4198-4207
Abstract
Diverse transport demands have resulted in the wide existence of heterogeneous vehicle automation systems. While these systems have demonstrated effectiveness, they also pose challenges in terms of the share of technological advancements among different organizations and lead to poor generalization ability of individual systems. This paper proposes a Transformer-based unified framework, VistaGPT, to address these challenges. VistaGPT, composed of Modular Federations of Vehicular Transformers (M-FoV) and Automated Composing of Autonomous Driving Systems (AutoAuto), aims to overcome the information barriers due to system-level and module-level heterogeneity. M-FoV collects and organizes Transformer-based models in a modular fashion to facilitate system integration by providing diversity and versatility. AutoAuto utilizes large language models (LLMs) to automatically compose end-to-end autonomous driving systems with a “Dividing and Recombining” strategy. Besides, we deploy Scenario Engineering systems to evaluate the composed systems and provide systematic feedback for the optimization of AutoAuto, and Federated intelligence to contribute to diverse training samples and applications. With its capacity, scalability, and diversity, VistaGPT provides a new paradigm of LLM-aided system development for transport automation, which promotes virtual-real interactive parallel driving and advances progress toward “6S” objectives.Keywords
Funding Information
- Key-Area Research and Development Program of Guangdong Province (2020B090921003)
- Key Research and Development Program of Guangzhou (202007050002)
- National Natural Science Foundation of China (U1811463, 62173329, 62203250)
- Young Elite Scientists Sponsorship Program of China Association of Science and Technology (YESS20220372, YESS20210289)
- China Postdoctoral Science Foundation (2023M733739, 2020TQ1057, 2020M682823)
This publication has 55 references indexed in Scilit:
- Multimodal Motion Prediction with Stacked Transformers2021
- PCT: Point cloud transformerComputational Visual Media, 2021
- Federated Ecology: Steps Toward Confederated IntelligenceIEEE Transactions on Computational Social Systems, 2021
- Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction2020
- ParallelEye-CS: A New Dataset of Synthetic Images for Testing the Visual Intelligence of Intelligent VehiclesIEEE Transactions on Vehicular Technology, 2019
- The ParallelEye Dataset: A Large Collection of Virtual Images for Traffic Vision ResearchIEEE Transactions on Intelligent Transportation Systems, 2018
- Training and testing object detectors with virtual imagesIEEE/CAA Journal of Automatica Sinica, 2018
- Parallel driving in CPSS: a unified approach for transport automation and vehicle intelligenceIEEE/CAA Journal of Automatica Sinica, 2017
- Steps toward Parallel IntelligenceIEEE/CAA Journal of Automatica Sinica, 2016
- A Survey of Traffic Control With Vehicular CommunicationsIEEE Transactions on Intelligent Transportation Systems, 2013