Traffic Signal Cycle Control With Centralized Critic and Decentralized Actors Under Varying Intervention Frequencies
- 26 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (12) , 20085-20104
Abstract
Traffic congestion in urban areas is a significant problem, leading to prolonged travel times, reduced efficiency, and increased environmental concerns. Effective traffic signal control (TSC) is a key strategy for reducing congestion. Unlike most TSC systems that rely on high-frequency control, this study introduces an innovative joint phase traffic signal cycle control method that operates effectively with varying control intervals. Our method features an adjust all phases action design, enabling simultaneous phase changes within the signal cycle, which fosters both immediate stability and sustained TSC effectiveness, especially at lower frequencies. The approach also integrates decentralized actors to handle the complexity of the action space, with a centralized critic to ensure coordinated phase adjusting. Extensive testing on both synthetic and real-world data across different intersection types and signal setups shows that our method significantly outperforms other popular techniques, particularly at high control intervals. Case studies of policies derived from traffic data further illustrate the robustness and reliability of our proposed method.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Stability analysis of stochastic second-order macroscopic continuum models and numerical simulationsTransportation Research Part B: Methodological, 2022
- Reinforcement learning in urban network traffic signal control: A systematic literature reviewExpert Systems with Applications, 2022
- AI in health and medicineNature Medicine, 2022
- Optimizing coordinated vehicle platooning: An analytical approach based on stochastic dynamic programmingTransportation Research Part B: Methodological, 2021
- Using ontology to guide reinforcement learning agents in unseen situationsApplied Intelligence, 2021
- Traffic signal optimization through discrete and continuous reinforcement learning with robustness analysis in downtown TehranAdvanced Engineering Informatics, 2018
- Adaptive traffic signal control with actor-critic methods in a real-world traffic network with different traffic disruption eventsTransportation Research Part C: Emerging Technologies, 2017
- A Study of Machine Learning in Healthcare2017
- Evaluating the safety impact of adaptive cruise control in traffic oscillations on freewaysAccident Analysis & Prevention, 2017
- An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control2016