Multi-agent deep reinforcement learning with actor-attention-critic for traffic light control
- 13 April 2023
- journal article
- research article
- Published by SAGE Publications in Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering
- Vol. 238 (9) , 2880-2888
Abstract
In recent years, with the increase of urbanization and car ownership, urban traffic congestion have become increasingly prominent. Traffic light control can effectively reduce urban traffic congestion. In the research of controlling traffic lights of multiple intersections, most methods introduced theories related to deep reinforcement learning, but few methods considered the information interaction between intersections or the way of information interaction is unreasonable. Inspired by this, this paper proposes a multi-agent deep reinforcement learning with actor-attention-critic network for traffic light control (MAAC-TLC) algorithm. In MAAC-TLC, each agent introduces the attention mechanism in the process of learning, so that it will not pay attention to all the information of other agents indiscriminately, but only focus on the important information of the agents that plays an important role in it, so as to ensure that all intersections can learn the optimal policy. Finally, the traffic lights at each intersection in the MAAC-TLC algorithm are controlled according to its own policy, thereby improving the traffic efficiency of the traffic network. The experimental results on light and heavy traffic flow scenarios have demonstrated that MAAC-TLC can improve traffic congestion at multiple intersections effectively.Keywords
Funding Information
- the national key Research and Development Program of China (No.2018YFB1003602)
This publication has 25 references indexed in Scilit:
- Traffic light control using deep policy‐gradient and value‐function‐based reinforcement learningIET Intelligent Transport Systems, 2017
- Distributed Cooperative Reinforcement Learning-Based Traffic Signal Control That Integrates V2X Networks’ Dynamic ClusteringIEEE Transactions on Vehicular Technology, 2017
- Traffic signal timing via deep reinforcement learningIEEE/CAA Journal of Automatica Sinica, 2016
- Parallel Systems for Traffic Control: A RethinkingIEEE Transactions on Intelligent Transportation Systems, 2015
- Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown TorontoIEEE Transactions on Intelligent Transportation Systems, 2013
- Urban traffic signal control using reinforcement learning agentsIET Intelligent Transport Systems, 2010
- Study on Traffic Signal Control Based on Q-Learning2009
- Multiagent Reinforcement Learning for Urban Traffic Control Using Coordination Graphs2008
- Optimizing networks of traffic signals in real time-the SCOOT methodIEEE Transactions on Vehicular Technology, 1991
- The Sydney coordinated adaptive traffic (SCAT) system philosophy and benefitsIEEE Transactions on Vehicular Technology, 1980