DRL-Based Robust Adaptive Traffic Signal Control with Low V2I Penetration Rate under Mixed Environment
- 12 March 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. PP (00189545) , 1-17
Abstract
Deep Reinforcement Learning (DRL) has become a widely adopted approach for adaptive traffic signal control, owing to its flexibility and effectiveness. However, DRL faces dimensionality and convergence challenges in large-scale multi-agent settings. Additionally, simplified representations of traffic conditions limit adaptability under mixed environments with pedestrians and weather factors. Moreover, in Vehicular Ad-Hoc Networks (VANETs) scenarios, low Vehicle-to-Infrastructure (V2I) penetration exacerbates the complexity of traffic observation and coordination. In this paper, we propose a DRL-based robust adaptive traffic signal control with a low V2I penetration rate under mixed environment (DRATSC). Specifically, DRATSC builds upon the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) framework, modeling intersections as autonomous agents and leveraging V2I to obtain real-time data. An attention mechanism is employed to dynamically focus on neighboring intersections, optimizing traffic signal coordination. The method overcomes low V2I penetration through scenario reconstruction and models mixed traffic environments by incorporating weather impacts, pedestrian interactions, and diverse action spaces. Extensive experiments conducted in the Simulation of Urban Mobility (SUMO) platform show that the proposed method improves overall performance by 40% over conventional approaches and outperforms IPDALight across most scenarios.Keywords
Funding Information
- National Natural Science Foundation of China (62402304)
- Shanghai Sailing Program (24YF2713100)
- National Key Research and Development Program of China (2023YFB2504800)
This publication has 35 references indexed in Scilit:
- Intelligent vehicle pedestrian light (IVPL): A deep reinforcement learning approach for traffic signal controlTransportation Research Part C: Emerging Technologies, 2023
- Data congestion control framework in Wireless Sensor Network in IoT enabled intelligent transportation systemMeasurement: Sensors, 2022
- IPDALight: Intensity- and phase duration-aware traffic signal control based on Reinforcement LearningJournal of Systems Architecture, 2022
- Adaptive Traffic Signal Control for large-scale scenario with Cooperative Group-based Multi-agent reinforcement learningTransportation Research Part C: Emerging Technologies, 2021
- An optimization model and traffic light control scheme for heterogeneous traffic systemsTransportation Research Part C: Emerging Technologies, 2021
- A better understanding on traffic light scheduling: New cellular GAs and new in-depth analysis of solutionsJournal of Computational Science, 2020
- The impacts of heavy rain on speed and headway Behaviors: An investigation using the SHRP2 naturalistic driving study dataTransportation Research Part C: Emerging Technologies, 2018
- Data communication in VANETs: Protocols, applications and challengesAd Hoc Networks, 2016
- Max pressure control of a network of signalized intersectionsTransportation Research Part C: Emerging Technologies, 2013
- Self-Organizing Traffic Lights: A Realistic Simulation2007