A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles
Open Access
- 20 February 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (4) , 2750
Abstract
The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.Keywords
Funding Information
- University of Tennessee Knoxville
This publication has 40 references indexed in Scilit:
- Distributed coordinated signal timing optimization in connected transportation networksTransportation Research Part C: Emerging Technologies, 2017
- Traffic signal timing optimization in connected vehicles environment2017
- Adaptive Coordination Based on Connected Vehicle TechnologyTransportation Research Record: Journal of the Transportation Research Board, 2017
- Dynamic Traffic Signal Timing Optimization Strategy Incorporating Various Vehicle Fuel Consumption CharacteristicsIEEE Transactions on Vehicular Technology, 2015
- A real-time adaptive signal control in a connected vehicle environmentTransportation Research Part C: Emerging Technologies, 2015
- Introduction to Fireworks AlgorithmInternational Journal of Swarm Intelligence Research, 2013
- Traffic Signal Control with Connected VehiclesTransportation Research Record: Journal of the Transportation Research Board, 2013
- PAMSCOD: Platoon-based arterial multi-modal signal control with online dataTransportation Research Part C: Emerging Technologies, 2012
- The cell transmission model: A dynamic representation of highway traffic consistent with the hydrodynamic theoryTransportation Research Part B: Methodological, 1994
- Partitioning procedures for solving mixed-variables programming problemsNumerische Mathematik, 1962