A Train Cooperative Operation Optimization Method based on Improved Reinforcement Learning Algorithm
Authors:
- 24 August 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
This paper mainly focuses on the high-speed train cooperative operation problem. To solve this problem, this paper presents a speed curve optimization method based on improved reinforcement learning algorithm. First, according to the train dynamics system, we build the speed curve optimization object. In order to realize the cooperative operation of trains, we use the artificial potential field method to establish the reward function for train spacing. At the same time, to ensure passenger comfort, train jerk rate also needs to be added into the reward function. And then, agent of improved reinforcement learning is established. The improved reinforcement learning algorithm is different from the general reinforcement learning algorithm in that the observation dimension of policy network is manually reduced compared with that of the Q value network to improve the learning speed of the algorithm. At the same time, in order to reduce the agent's attempts to perform useless actions in some states, a reference controller is added to the system to further accelerate the learning process. In addition, training parameters need to be set, such as training termination conditions, maximum number of steps, desired global reward value, and so on. After the training. The Agent can generate a desirable speed curve of train based on constraints of vehicle output and jerk rate under cooperative operation.Keywords
Funding Information
- National Natural Science Foundation of China (U1934221,U21A20169)
This publication has 12 references indexed in Scilit:
- Event-triggered adaptive control for multiple high-speed trains with deception attacks in bottleneck sectionsInformation Sciences, 2021
- A Survey on Visual Navigation for Artificial Agents With Deep Reinforcement LearningIEEE Access, 2020
- A Model Predictive Control Approach for Virtual Coupling in RailwaysIEEE Transactions on Intelligent Transportation Systems, 2019
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Cooperative control of high-speed trains for headway regulation: A self-triggered model predictive control based approachTransportation Research Part C: Emerging Technologies, 2019
- Distributed cooperative control of multiple high-speed trains under a moving block system by nonlinear mapping-based feedbackScience China Information Sciences, 2018
- Cooperative Prescribed Performance Tracking Control for Multiple High-Speed Trains in Moving Block Signaling SystemIEEE Transactions on Intelligent Transportation Systems, 2018
- Automatic Train Control: Protection Principles1991
- Learning to predict by the methods of temporal differencesMachine Learning, 1988
- Electron Spectroscopy Studies on Magneto-Optical Media and Plastic Substrate InterfaceIEEE Translation Journal on Magnetics in Japan, 1987