Exploring reward shaping in discrete and continuous action spaces: A deep reinforcement learning study on Turtlebot3
Open Access
- 4 October 2024
- journal article
- Published by Wiley in Proceedings in Applied Mathematics and Mechanics
- Vol. 24 (3)
Abstract
In robotics, reinforcement learning can train controllers or agents to find optimal solutions for complex tasks by enabling the robot to interact repeatedly with the environment. The reward function is an important aspect that guides any reinforcement algorithm to find the desired solution successfully. This work examines two deep reinforcement learning approaches, one uses a Deep Q‐Network(DQN) and the other a deep deterministic policy gradient (DDPG) algorithm, applicable to navigation tasks for mobile robots. Comparison between different reward schemes for both algorithms is one of the main focuses in this work. The methodology is implemented in the simulation for a mobile robot called TurtleBot3. The task for the robot is to navigate through obstacles from an initial location to a goal position. Finally, the trained end‐to‐end navigation stack is also implemented on the actual TurtleBot3 in a real environment. The robot uses a Lidar sensor to detect obstacles. The Lidar measurements and the relative position and angle of the robot to the target location are the inputs to the controller. The TurtleBot3 also utilizes distance information from its Lidar sensor to create an environmental map using the simultaneous localization and mapping (SLAM) technique. Additionally, given an initial position, the robot employs its inertial measurement unit (IMU) sensor and encoders for precise localization.Keywords
This publication has 6 references indexed in Scilit:
- Autonomous Navigation of Robots: Optimization with DQNApplied Sciences, 2023
- Swing Up and Balance of an Inverted Pendulum Using Reinforced Learning Approach Coupled With a Proportional-Integral-Derivative Controller2022
- An application of deep reinforcement learning to algorithmic tradingExpert Systems with Applications, 2021
- An offline multi‐scale unsaturated poromechanics model enabled by self‐designed/self‐improved neural networksInternational Journal for Numerical and Analytical Methods in Geomechanics, 2021
- Deep Reinforcement Learning with Double Q-LearningProceedings of the AAAI Conference on Artificial Intelligence, 2016
- Design and use paradigms for gazebo, an open-source multi-robot simulator2005