Autonomous braking system via deep reinforcement learning
Authors:
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
In this paper, we propose a new autonomous braking system based on deep reinforcement learning. The proposed autonomous braking system automatically decides whether to apply the brake at each time step when confronting the risk of collision using the information on the obstacle obtained by the sensors. The problem of designing brake control is formulated as searching for the optimal policy in Markov decision process (MDP) model where the state is given by the relative position of the obstacle and the vehicle's speed, and the action space is defined as the set of the brake actions including 1) no braking, 2) weak, 3) mid, 4) strong brakiong actions. The policy used for brake control is learned through computer simulations using the deep reinforcement learning method called deep Q-network (DQN). In order to derive desirable braking policy, we propose the reward function which balances the damage imposed to the obstacle in case of accident and the reward achieved when the vehicle runs out of risk as soon as possible. DQN is trained for the scenario where a vehicle is encountered with a pedestrian crossing the urban road. Experiments show that the control agent exhibits desirable control behavior and avoids collision without any mistake in various uncertain environments.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Deep Convolutional Neural Networks for pedestrian detectionSignal Processing: Image Communication, 2016
- DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving2015
- Human-level control through deep reinforcement learningNature, 2015
- Evolving deep unsupervised convolutional networks for vision-based reinforcement learning2014
- Cooperative Adaptive Cruise Control: A Reinforcement Learning ApproachIEEE Transactions on Intelligent Transportation Systems, 2011
- Neural Network Based Lane Change Trajectory Prediction in Autonomous Vehicles2011
- Evaluation of automotive forward collision warning and collision avoidance algorithmsVehicle System Dynamics, 2005
- Research advances in intelligent collision avoidance and adaptive cruise controlIEEE Transactions on Intelligent Transportation Systems, 2003