Enhanced Delta-tolling: Traffic Optimization via Policy Gradient Reinforcement Learning
Authors:
- 1 November 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 47-52
Abstract
In the micro-tolling paradigm, a centralized system manager sets different toll values for each link in a given traffic network with the objective of optimizing the system's performance. A recently proposed micro-tolling scheme, denoted Δ-tolling, was shown to yield up to 32% reduction in total travel time when compared to a no-toll scheme. Δ-tolling, computes a toll value for each link in a given network based on two global parameters: β which is a proportional parameter and R which controls the rate of toll change over time. In this paper, we propose to generalize Δ-tolling such that it would consider different R and β parameters for each link. a policy gradient reinforcement learning algorithm is used in order to tune this high-dimensional optimization problem. The results show that such a variant of Δ-tolling far surpasses the original Δ-tolling scheme, yielding up to 38% reduced system travel time compared to the original Δ-tolling scheme.Keywords
This publication has 17 references indexed in Scilit:
- Improving the Convergence of Simulation-based Dynamic Traffic Assignment MethodologiesNetworks and Spatial Economics, 2014
- Development and comparison of choice models and tolling schemes for high-occupancy/toll (HOT) facilitiesTransportation Research Part B: Methodological, 2013
- Opportunities for multiagent systems and multiagent reinforcement learning in traffic controlAutonomous Agents and Multi-Agent Systems, 2008
- Sensitivity of Static Traffic User Equilibria with Perturbations in Arc Cost Function and Travel DemandTransportation Science, 2008
- Trial-and-error implementation of marginal-cost pricing on networks in the absence of demand functionsTransportation Research Part B: Methodological, 2004
- Minimal-revenue congestion pricing part I: A fast algorithm for the single-origin caseTransportation Research Part B: Methodological, 1999
- The cell transmission model, part II: Network trafficTransportation Research Part B: Methodological, 1995
- The cell transmission model: A dynamic representation of highway traffic consistent with the hydrodynamic theoryTransportation Research Part B: Methodological, 1994
- An efficient approach to solving the road network equilibrium traffic assignment problemTransportation Research, 1975
- Shock Waves on the HighwayOperations Research, 1956