Deep Q‐network implementation for simulated autonomous vehicle control
Open Access
- 5 May 2021
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 15 (7) , 875-885
Abstract
Deep reinforcement learning is poised to be a revolutionised step towards newer possibilities in solving navigation and autonomous vehicle control tasks. Deep Q‐network (DQN) is one of the more popular methods of deep reinforcement learning that allows the agent that controls the vehicle to learn through its mistakes based on its actions and interactions with the environment. This paper presents the implementation of DQN to an autonomous self‐driving vehicle control in two different simulated environments; first environment is in Python which is a simple 2D environment and then advanced to Unity software separately which is a 3D environment. Based on the scores and pixel inputs, the agent in the vehicle learns and adapts to its surrounding. It develops the best solution strategy to direct itself in the environment where its task is to manoeuvre the vehicle from point to point on a simulated highway scenario. The implemented DQN technique approximates the action value function with convolutional neural network. This evaluates the Q‐function for the Q‐learning architecture and updates the action value function. This paper shows that DQN is an effective learning method for the agent of an autonomous vehicle. In both simulated environments, the autonomous vehicle gradually learnt the manoeuvre operations and progressively gained the ability to successfully navigate itself and avoid obstacles without prior information of the surrounding.Keywords
This publication has 29 references indexed in Scilit:
- Deep learning algorithm for autonomous driving using GoogLeNet2017
- CNN-based single image obstacle avoidance on a quadrotor2017
- Learning a deep neural net policy for end-to-end control of autonomous vehicles2017
- A Control Strategy of Autonomous Vehicles Based on Deep Reinforcement Learning2016
- Topic-Aware Deep Compositional Models for Sentence ClassificationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016
- Autonomous vehicles: challenges, opportunities, and future implications for transportation policiesJournal of Modern Transportation, 2016
- A robot exploration strategy based on Q-learning network2016
- Human-level control through deep reinforcement learningNature, 2015
- A novel dual iterative Q-learning method for optimal battery management in smart residential environmentsIEEE Transactions on Industrial Electronics, 2014
- Q-learning Based on Neural Network in Learning Action Selection of Mobile Robot2007