Transferable Model-Based Reinforcement Learning for Vehicular Platoon Control
- 6 March 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 27 (7) , 8401-8410
Abstract
The learning efficiency remains a critical impediment to the practical application of connected and automated vehicles (CAVs). This paper proposes a transferable model-based reinforcement learning (TMBRL) strategy to enhance the sample efficiency and learning rate of CAVs. Specifically, a surrogate policy model is established by capturing state transitions between the actual environment and the vehicle within traffic scenarios. Then, a model-based reinforcement learning (MBRL) approach is established utilizing a surrogate model and a soft actor-critic algorithm. To improve the learning efficiency of platoon control algorithm, a transfer learning method is implemented to MBRL framework. Specifically, the trained surrogate model of vehicles in the source domain is transferred to vehicles in the target domain, and the latter just should update the surrogate model in terms of the individual dynamic characteristics and tasks. Finally, a platoon experiment platform with Prescan software is conducted. The experimental evaluation demonstrates that the TMBRL strategy significantly outperforms conventional reinforcement learning approaches, achieving higher average cumulative reward of 47 and demonstrating a 16% improvement in training success rate. Comparative analysis further reveals that the proposed TMBRL strategy exhibits superior robustness in platoon tracking tasks, maintaining enhanced trajectory tracking precision and stability under dynamic environmental conditions.Keywords
Funding Information
- National Natural Science Foundation of China (62503426)
- Zhejiang Province Natural Science Foundation (LQN26F030031)
- Zhejiang Province Natural Science Foundation (LD26F020004)
- Royal Society (IES R3243278)
This publication has 31 references indexed in Scilit:
- Large-Scale Vehicle Platooning: Advances and Challenges in Scheduling and Planning TechniquesEngineering, 2023
- Multi-agent reinforcement learning for autonomous vehicles: a surveyAutonomous Intelligent Systems, 2022
- Model Controlled Prediction: A Reciprocal Alternative of Model Predictive ControlIEEE/CAA Journal of Automatica Sinica, 2022
- Efficient and Secure Data Sharing for 5G Flying Drones: A Blockchain-Enabled ApproachIEEE Network, 2021
- Approximate Arithmetic Circuits: A Survey, Characterization, and Recent ApplicationsProceedings of the IEEE, 2020
- Model-Based Reinforcement Learning for Time-Optimal Velocity ControlIEEE Robotics and Automation Letters, 2020
- Investigating the state of connected and autonomous vehicles: a literature ReviewTransportation Research Procedia, 2020
- Survey of Model-Based Reinforcement Learning: Applications on RoboticsJournal of Intelligent & Robotic Systems, 2017
- The vehicle platooning problem: Computational complexity and heuristicsTransportation Research Part C: Emerging Technologies, 2015
- Reinforcement learning improves behaviour from evaluative feedbackNature, 2015