Neural Networks for Real-Time Traffic Signal Control
Authors:
- D. SrinivasanDSD. Srinivasan
- M.C. ChoyMCM.C. Choy
- R.L. CheuRCR.L. Cheu
Top Cited Papers
- 6 September 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 7 (3) , 261-272
Abstract
Real-time traffic signal control is an integral part of the urban traffic control system, and providing effective real-time traffic signal control for a large complex traffic network is an extremely challenging distributed control problem. This paper adopts the multiagent system approach to develop distributed unsupervised traffic responsive signal control models, where each agent in the system is a local traffic signal controller for one intersection in the traffic network. The first multiagent system is developed using hybrid computational intelligent techniques. Each agent employs a multistage online learning process to update and adapt its knowledge base and decision-making mechanism. The second multiagent system is developed by integrating the simultaneous perturbation stochastic approximation theorem in fuzzy neural networks (NN). The problem of real-time traffic signal control is especially challenging if the agents are used for an infinite horizon problem, where online learning has to take place continuously once the agent-based traffic signal controllers are implemented into the traffic network. A comprehensive simulation model of a section of the Central Business District of Singapore has been developed using PARAMICS microscopic simulation program. Simulation results show that the hybrid multiagent system provides significant improvement in traffic conditions when evaluated against an existing traffic signal control algorithm as well as the SPSA-NN-based multiagent system as the complexity of the simulation scenario increases. Using the hybrid NN-based multiagent system, the mean delay of each vehicle was reduced by 78% and the mean stoppage time, by 85% compared to the existing traffic signal control algorithm. The promising results demonstrate the efficacy of the hybrid NN-based multiagent system in solving large-scale traffic signal control problems in a distributed mannerKeywords
This publication has 20 references indexed in Scilit:
- Fuzzy sets in distributed traffic control2002
- Genetic reinforcement learning for cooperative traffic signal control2002
- On the use of simultaneous perturbation stochastic approximation for neural network training1999
- Nonlinear stabilization by receding-horizon neural regulatorsInternational Journal of Control, 1998
- Traffic-responsive signal timing for system-wide traffic controlTransportation Research Part C: Emerging Technologies, 1997
- On the Convergence of Stochastic Iterative Dynamic Programming AlgorithmsNeural Computation, 1994
- Multivariate stochastic approximation using a simultaneous perturbation gradient approximationIEEE Transactions on Automatic Control, 1992
- On the Convergence of the LMS Algorithm with Adaptive Learning Rate for Linear Feedforward NetworksNeural Computation, 1991
- Increased rates of convergence through learning rate adaptationNeural Networks, 1988
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951