Adaptive Traffic Signal Control Using Distributed MARL and Federated Learning
Authors:
- 28 October 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1242-1248
Abstract
Facing the increasingly serious traffic congestion problem, the existing traffic signal control technology has been unable to meet the demands of urban smart traffic construction. As one of the most promising methods, Reinforcement Learning (RL) has been widely exploited for solving the adaptive traffic signal control (ATSC) problem. However, centralized RL control mode is impractical due to its poor robustness and high computational complexity. In this paper, we propose two distributed Multi-agent Reinforcement Learning (MARL) control modes as well as a Federated Learning (FL) framework to solve the ATSC problem, where the former is based on Advantage Actor-Critic (A2C) algorithm and the latter is based on Federated Averaging (FedAvg) algorithm. By comparing in a small grid of traffic network, the experimental results reveal that our proposed algorithms outperform the centralized solution in terms of both the optimality and the learning efficiency.Keywords
This publication has 12 references indexed in Scilit:
- Vehicle Tracking in Wireless Sensor Networks via Deep Reinforcement LearningIEEE Sensors Letters, 2020
- Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement LearningIEEE Communications Letters, 2019
- Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal ControlIEEE Transactions on Intelligent Transportation Systems, 2019
- Adaptive traffic signal control with actor-critic methods in a real-world traffic network with different traffic disruption eventsTransportation Research Part C: Emerging Technologies, 2017
- Cooperative Multi-agent Control Using Deep Reinforcement Learning2017
- Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown TorontoIEEE Transactions on Intelligent Transportation Systems, 2013
- Safety of Channelized Right-Turn Lanes for Motor Vehicles and PedestriansTransportation Research Record: Journal of the Transportation Research Board, 2013
- Fuzzy Q-Learning Admission Control for WCDMA/WLAN Heterogeneous Networks with Multimedia TrafficIEEE Transactions on Mobile Computing, 2009
- Reinforcement Learning: An IntroductionNeurocomputing, 2000
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998