A Reinforcement Learning approach for bus network design and frequency setting optimisation
Authors:
Open Access
- 8 February 2023
- journal article
- research article
- Published by Springer Nature in Public Transport
- Vol. 15 (2) , 503-534
Abstract
This paper proposes a new approach to solve the problem of bus network design and frequency setting (BNDFS). Transit network design must satisfy the needs of both service users and transit operators. Numerous optimisation techniques have been proposed for BNDFS in the literature. Previous approaches tend to adopt a sequential optimisation strategy that conducts network routing and service frequency setting in two separate steps. To address the limitation of sequential optimisation, our new algorithm uses Reinforcement Learning for a simultaneous optimisation of three key components of BNDFS: the number of bus routes, the route design and service frequencies. The algorithm can design the best set of bus routes without defining the total number of bus routes in advance, which can reduce the overall computational time. The proposed algorithm was tested on the benchmark Mandl Swiss network. The algorithm is further extended to the routing of express services. The validation includes additional test scenarios which modify the transit demand level on the Mandl network. The new algorithm can be useful to assist transit agencies and planners in improving existing routing and service frequency to cope with changing demand conditions.Keywords
This publication has 64 references indexed in Scilit:
- Robust Optimization Model of Bus Transit Network Design with Stochastic Travel TimeJournal of Transportation Engineering, 2013
- Urban traffic signal control using reinforcement learning agentsIET Intelligent Transport Systems, 2010
- Reinforcement learning-based multi-agent system for network traffic signal controlIET Intelligent Transport Systems, 2010
- A route set construction algorithm for the transit network design problemComputers & Operations Research, 2009
- A tabu search approach to an urban transport problem in northern SpainComputers & Operations Research, 2009
- Tabu Search Strategies for the Public Transportation Network Optimizations with Variable Transit DemandComputer-Aided Civil and Infrastructure Engineering, 2008
- Genetic Algorithms for Optimal Urban Transit Network DesignComputer-Aided Civil and Infrastructure Engineering, 2003
- Successful Arterial Street Limited-Stop Express Bus Service in ChicagoTransportation Research Record: Journal of the Transportation Research Board, 2001
- Planning and Design Model for Transit Route Networks with Coordinated OperationsTransportation Research Record: Journal of the Transportation Research Board, 1998
- Ant system: optimization by a colony of cooperating agentsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1996