Dual-Objective Reinforcement Learning-Based Adaptive Traffic Signal Control for Decarbonization and Efficiency Optimization
Open Access
- 30 June 2024
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 12 (13) , 2056
Abstract
To improve traffic efficiency, adaptive traffic signal control (ATSC) systems have been widely developed. However, few studies have proactively optimized the air environmental issues in the development of ATSC. To fill this research gap, this study proposes an optimized ATSC algorithm to take into consideration both traffic efficiency and decarbonization. The proposed algorithm is developed based on the deep reinforcement learning (DRL) framework with dual goals (DRL-DG) for traffic control system optimization. A novel network structure combining Convolutional Neural Networks and Long Short-Term Memory Networks is designed to map the intersection traffic state to a Q-value, accelerating the learning process. The reward mechanism involves a multi-objective optimization function, employing the entropy weight method to balance the weights among dual goals. Based on a representative intersection in Changsha, Hunan Province, China, a simulated intersection scenario is constructed to train and test the proposed algorithm. The result shows that the ATSC system optimized by the proposed DRL-DG results in a reduction of more than 71% in vehicle waiting time and 46% in carbon emissions compared to traditional traffic signal control systems. It converges faster and achieves a balanced dual-objective optimization compared to the prevailing DRL-based ATSC.Keywords
Funding Information
- National Key Research and Development Program of China (2023YFB2504704, S2023JJQNJJ1969)
- Natural Science Foundation in Hunan Province (2023YFB2504704, S2023JJQNJJ1969)
This publication has 80 references indexed in Scilit:
- A variable speed limit control approach for freeway tunnels based on the model-based reinforcement learning framework with safety perceptionAccident Analysis & Prevention, 2024
- An eco-driving strategy for autonomous electric vehicles crossing continuous speed-limit signalized intersectionsEnergy, 2024
- Multi-objective deep reinforcement learning approach for adaptive traffic signal control system with concurrent optimization of safety, efficiency, and decarbonization at intersectionsAccident Analysis & Prevention, 2024
- Distributed edge signal control for cooperating pre-planned connected automated vehicle path and signal timing at edge computing-enabled intersectionsExpert Systems with Applications, 2023
- Real-time crash risk prediction in freeway tunnels considering features interaction and unobserved heterogeneity: A two-stage deep learning modeling frameworkAnalytic Methods in Accident Research, 2023
- Restricted crossing U-turn traffic control by interval Type-2 fuzzy logicExpert Systems with Applications, 2022
- Reinforcement learning in urban network traffic signal control: A systematic literature reviewExpert Systems with Applications, 2022
- Evaluating Action Durations for Adaptive Traffic Signal Control Based On Deep Q-LearningInternational Journal of Intelligent Transportation Systems Research, 2021
- Distributed and adaptive traffic signal control within a realistic traffic simulationEngineering Applications of Artificial Intelligence, 2013
- The development of taiwan arterial traffic‐adaptive signal control system and its field test: A taiwan experienceJournal of Advanced Transportation, 2009