Yaqi Xu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Yaqi Xu has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Yan Shi
State key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China
5 shared publications Shanzhi Chen
4 shared publicationsYuming Ge
4 shared publicationsJin Tian
3 shared publications- Shanzhi Chen
State Key Laboratory of Wireless Mobile Communications, China Academy of Telecommunication Technology, Beijing 100191, China
2 shared publications - Yuming Ge
Institute of Technology and Standards, China Academy of Information and Communications Technology
2 shared publications
Latest Publications
- 1 June 2026
- Published by Elsevier in Computer Networks
- Vol. 286
DCT-MARL: Dynamic communication topology adaptation for cooperative vehicle platooning under non-ideal V2V communications
- 1 June 2026
- Published by Elsevier in Computer Networks
- Vol. 286
DCT-MARL: Dynamic communication topology adaptation for cooperative vehicle platooning under non-ideal V2V communications
- Open Access
- 30 March 2026
- Published by Elsevier in SSRN Electronic Journal
DCT-MARL: Dynamic Communication Topology Adaptation for Cooperative Vehicle Platooning under Non-Ideal V2V Communications
With the rapid advancement of vehicular communication facilities and autonomous driving technologies, connected vehicle platooning has emerged as a promising approach to improve traffic efficiency and driving safety. Reliable and low-latency Vehicle-to-Vehicle (V2V) communication is essential for enabling efficient cooperative driving in vehicular networks. However, in the real-world traffic environment, V2V communication may suffer from time-varying delay and packet loss, leading to degraded control performance. To mitigate the adverse effects of non-ideal communication, this paper proposes a Dynamic Communication Topology based Multi-Agent Reinforcement Learning (DCT-MARL) algorithm for robust cooperative platooning. In the proposed framework, each agent dynamically adjusts its communication topology based on causal confidence, which characterizes the decision-relevant importance of other vehicles’ behaviors to its control decision under the current driving context. A multi-key gating network is designed to realize the communication topology adapt mechanism, and a state augmentation scheme is further incorporated to enhance robustness against communication delays. Simulation results demonstrate that the proposed DCT-MARL significantly outperforms state-of-the-art methods in terms of string stability and driving comfort, while improving robustness under unreliable V2V communication conditions, validating its superior effectiveness in realistic vehicular networking environments.
- 30 March 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessDCT-MARL: Dynamic Communication Topology Adaptation for Cooperative Vehicle Platooning under Non-Ideal V2V Communications
With the rapid advancement of vehicular communication facilities and autonomous driving technologies, connected vehicle platooning has emerged as a promising approach to improve traffic efficiency and driving safety. Reliable and low-latency Vehicle-to-Vehicle (V2V) communication is essential for enabling efficient cooperative driving in vehicular networks. However, in the real-world traffic environment, V2V communication may suffer from time-varying delay and packet loss, leading to degraded control performance. To mitigate the adverse effects of non-ideal communication, this paper proposes a Dynamic Communication Topology based Multi-Agent Reinforcement Learning (DCT-MARL) algorithm for robust cooperative platooning. In the proposed framework, each agent dynamically adjusts its communication topology based on causal confidence, which characterizes the decision-relevant importance of other vehicles’ behaviors to its control decision under the current driving context. A multi-key gating network is designed to realize the communication topology adapt mechanism, and a state augmentation scheme is further incorporated to enhance robustness against communication delays. Simulation results demonstrate that the proposed DCT-MARL significantly outperforms state-of-the-art methods in terms of string stability and driving comfort, while improving robustness under unreliable V2V communication conditions, validating its superior effectiveness in realistic vehicular networking environments.
- Open Access
DCT-MARL: A Dynamic Communication Topology-Based MARL Algorithm for Connected Vehicle Platoon Control
With the rapid advancement of vehicular communication facilities and autonomous driving technologies, connected vehicle platooning has emerged as a promising approach to improve traffic efficiency and driving safety. Reliable Vehicle-to-Vehicle (V2V) communication is critical to achieving efficient cooperative control. However, in the real-world traffic environment, V2V communication may suffer from time-varying delay and packet loss, leading to degraded control performance and even safety risks. To mitigate the adverse effects of non-ideal communication, this paper proposes a Dynamic Communication Topology based Multi-Agent Reinforcement Learning (DCT-MARL) algorithm for robust cooperative platoon control. Specifically, the state space is augmented with historical control action and delay to enhance robustness against communication delay. To mitigate the impact of packet loss, a multi-key gated communication mechanism is introduced, which dynamically adjusts the communication topology based on the correlation between vehicles and their current communication status. Simulation results demonstrate that the proposed DCT-MARL significantly outperforms state-of-the-art methods in terms of string stability and driving comfort, validating its superior robustness and effectiveness.
Open AccessDCT-MARL: A Dynamic Communication Topology-Based MARL Algorithm for Connected Vehicle Platoon Control
With the rapid advancement of vehicular communication facilities and autonomous driving technologies, connected vehicle platooning has emerged as a promising approach to improve traffic efficiency and driving safety. Reliable Vehicle-to-Vehicle (V2V) communication is critical to achieving efficient cooperative control. However, in the real-world traffic environment, V2V communication may suffer from time-varying delay and packet loss, leading to degraded control performance and even safety risks. To mitigate the adverse effects of non-ideal communication, this paper proposes a Dynamic Communication Topology based Multi-Agent Reinforcement Learning (DCT-MARL) algorithm for robust cooperative platoon control. Specifically, the state space is augmented with historical control action and delay to enhance robustness against communication delay. To mitigate the impact of packet loss, a multi-key gated communication mechanism is introduced, which dynamically adjusts the communication topology based on the correlation between vehicles and their current communication status. Simulation results demonstrate that the proposed DCT-MARL significantly outperforms state-of-the-art methods in terms of string stability and driving comfort, validating its superior robustness and effectiveness.
- 4 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (8) , 9927-9939
MSRA: Mode Selection and Resource Allocation for Cooperative Vehicle-Infrastructure System
Cellular vehicle-to-everything (C-V2X) communication is essential for supporting diverse vehicle applications in Cooperative Vehicle-Infrastructure Systems (CVIS). However, various factors such as building obstructions, signal blockages, and network conditions severely affect the latency and reliability of V2V communication. To address this challenge, we propose a novel dynamic method for communication Mode Selection and Resource Allocation in C-V2X, termed MSRA, which enables vehicles to dynamically select and utilize different communication modes such as V2V, Vehicle-to-Infrastructure (V2I), and Vehicle-to-Network (V2N) for direct, relay, or forwarding communication, based on real-time conditions. To this end, we formulate the joint optimization problem of mode selection and resource allocation as a Markov Decision Process (MDP) and propose a solution based on Multi-Agent Reinforcement Learning (MARL) with centralized training and decentralized execution. Specifically, each vehicle acts as an agent, independently selecting communication modes and resources based on real-time network status and communication link quality, aiming to satisfy the latency and reliability requirements of V2V communication while maximizing the capacity of V2N communication based on heterogeneous Quality of Service (QoS) requirements. Simulation results indicate that the proposed algorithm significantly outperforms other decentralized baselines and demonstrates superior performance under various conditions.
- 4 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (8) , 9927-9939
MSRA: Mode Selection and Resource Allocation for Cooperative Vehicle-Infrastructure System
Cellular vehicle-to-everything (C-V2X) communication is essential for supporting diverse vehicle applications in Cooperative Vehicle-Infrastructure Systems (CVIS). However, various factors such as building obstructions, signal blockages, and network conditions severely affect the latency and reliability of V2V communication. To address this challenge, we propose a novel dynamic method for communication Mode Selection and Resource Allocation in C-V2X, termed MSRA, which enables vehicles to dynamically select and utilize different communication modes such as V2V, Vehicle-to-Infrastructure (V2I), and Vehicle-to-Network (V2N) for direct, relay, or forwarding communication, based on real-time conditions. To this end, we formulate the joint optimization problem of mode selection and resource allocation as a Markov Decision Process (MDP) and propose a solution based on Multi-Agent Reinforcement Learning (MARL) with centralized training and decentralized execution. Specifically, each vehicle acts as an agent, independently selecting communication modes and resources based on real-time network status and communication link quality, aiming to satisfy the latency and reliability requirements of V2V communication while maximizing the capacity of V2N communication based on heterogeneous Quality of Service (QoS) requirements. Simulation results indicate that the proposed algorithm significantly outperforms other decentralized baselines and demonstrates superior performance under various conditions.
- 18 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (11) , 16160-16172
A Multi-Agent Reinforcement Learning Based Control Method for CAVs in a Mixed Platoon
With the development of automatic driving technology and the Internet of Vehicles, platooning based on control of Connected and Autonomous Vehicles (CAVs) has become one of the most promising approach to improve traffic efficiency and safety. However, CAVs and Human-Driven Vehicles (HDVs) will coexist for a long period, and the inherent randomness of HDVs may cause traffic flow oscillations within the mixed platoon. This paper proposes a mixed platoon control strategy, Relative Position Encoding Multi Actor Attention Critic (RPE-MAAC), for CAVs operating in mixed platoons with HDVs. To be more specific, RPE-MAAC integrates relative position encoding into the MAAC framework, enhancing the model's capability to handle spatial relationships among platoon members and improve platooning control effectiveness. By incorporating HDV reaction delays in the reward function, RPE-MAAC ensures the stability of the mixed platoon, reducing disruptions and enhancing driving comfort. In particular, the more accurate HDV trajectory generation model, IDM-Informer, is incorporated into the problem formulation to provide feedback that more closely resembles real-world mixed platoon scenarios. Lastly, the effectiveness and stability of the proposed RPE-MAAC-based controller is verified through numerical simulations under various conditions. The superior performance of the proposed algorithm is shown by comparing with existing traditional algorithms and state-of-the-art optimization algorithms.
- 18 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (11) , 16160-16172
A Multi-Agent Reinforcement Learning Based Control Method for CAVs in a Mixed Platoon
With the development of automatic driving technology and the Internet of Vehicles, platooning based on control of Connected and Autonomous Vehicles (CAVs) has become one of the most promising approach to improve traffic efficiency and safety. However, CAVs and Human-Driven Vehicles (HDVs) will coexist for a long period, and the inherent randomness of HDVs may cause traffic flow oscillations within the mixed platoon. This paper proposes a mixed platoon control strategy, Relative Position Encoding Multi Actor Attention Critic (RPE-MAAC), for CAVs operating in mixed platoons with HDVs. To be more specific, RPE-MAAC integrates relative position encoding into the MAAC framework, enhancing the model's capability to handle spatial relationships among platoon members and improve platooning control effectiveness. By incorporating HDV reaction delays in the reward function, RPE-MAAC ensures the stability of the mixed platoon, reducing disruptions and enhancing driving comfort. In particular, the more accurate HDV trajectory generation model, IDM-Informer, is incorporated into the problem formulation to provide feedback that more closely resembles real-world mixed platoon scenarios. Lastly, the effectiveness and stability of the proposed RPE-MAAC-based controller is verified through numerical simulations under various conditions. The superior performance of the proposed algorithm is shown by comparing with existing traditional algorithms and state-of-the-art optimization algorithms.
- Open Access
- 7 November 2023
- Published by MDPI AG in Sustainability
- Vol. 15 (22) , 15714
A Computer Vision-Based Algorithm for Detecting Vehicle Yielding to Pedestrians
Computer vision has made remarkable progress in traffic surveillance, but determining whether a motor vehicle yields to pedestrians still requires considerable human effort. This study proposes an automated method for detecting whether a vehicle yields to pedestrians in intelligent transportation systems. The method employs a target-tracking algorithm that uses feature maps and license plate IDs to track the motion of relevant elements in the camera’s field of view. By analyzing the positions of motor vehicles and pedestrians over time, we predict the warning points of pedestrians and hazardous areas in front of vehicles to determine whether the vehicles yield to pedestrians. Extensive experiments are conducted on the MOT16 dataset, real traffic street scene video dataset, and a Unity3D virtual simulation scene dataset combined with SUMO, which demonstrating the superiority of this tracking algorithms. Compared to the current state-of-the-art methods, this method demonstrates significant improvements in processing speed without compromising accuracy. Specifically, this approach substantially outperforms in operational efficiency, thus catering aptly to real-time recognition requirements. This meticulous experimentation and evaluations reveal a commendable reduction in ID switches, enhancing the reliability of violation attributions to the correct vehicles. Such enhancement is crucial in practical urban settings characterized by dynamic interactions and variable conditions. This approach can be applied in various weather, time, and road conditions, achieving high predictive accuracy and interpretability in detecting vehicle–pedestrian interactions. This advanced algorithm illuminates the viable pathways for integrating technological innovation and sustainability, paving the way for more resilient and intelligent urban ecosystems.
- 7 November 2023
- Published by MDPI AG in Sustainability
- Vol. 15 (22) , 15714
Open AccessA Computer Vision-Based Algorithm for Detecting Vehicle Yielding to Pedestrians
Computer vision has made remarkable progress in traffic surveillance, but determining whether a motor vehicle yields to pedestrians still requires considerable human effort. This study proposes an automated method for detecting whether a vehicle yields to pedestrians in intelligent transportation systems. The method employs a target-tracking algorithm that uses feature maps and license plate IDs to track the motion of relevant elements in the camera’s field of view. By analyzing the positions of motor vehicles and pedestrians over time, we predict the warning points of pedestrians and hazardous areas in front of vehicles to determine whether the vehicles yield to pedestrians. Extensive experiments are conducted on the MOT16 dataset, real traffic street scene video dataset, and a Unity3D virtual simulation scene dataset combined with SUMO, which demonstrating the superiority of this tracking algorithms. Compared to the current state-of-the-art methods, this method demonstrates significant improvements in processing speed without compromising accuracy. Specifically, this approach substantially outperforms in operational efficiency, thus catering aptly to real-time recognition requirements. This meticulous experimentation and evaluations reveal a commendable reduction in ID switches, enhancing the reliability of violation attributions to the correct vehicles. Such enhancement is crucial in practical urban settings characterized by dynamic interactions and variable conditions. This approach can be applied in various weather, time, and road conditions, achieving high predictive accuracy and interpretability in detecting vehicle–pedestrian interactions. This advanced algorithm illuminates the viable pathways for integrating technological innovation and sustainability, paving the way for more resilient and intelligent urban ecosystems.
- 3 August 2023
- Published by Elsevier in Computer Networks
- Vol. 235
Informer-based QoS prediction for V2X communication: A method with verification using reality field test data
- 3 August 2023
- Published by Elsevier in Computer Networks
- Vol. 235
Informer-based QoS prediction for V2X communication: A method with verification using reality field test data