A Quantum-inspired Q-learning Algorithm for Indoor Robot Navigation
- 1 April 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1599-1603
Abstract
A quantum-inspired Q-learning (QIQL) algorithm is proposed for indoor robot navigation control. Q- learning is an action-dependent reinforcement learning method and has been widely used in robot navigation. Inspired by the fundamental characteristics of quantum computation, e.g. state superposition principle and quantum parallel computation, probability is introduced to Q-learning and along with the learning process the probability of each action to be selected at a certain state is updated, which leads to a natural exploration strategy instead of a pointed one with configured parameters. The simulated navigation experiments show that the proposed QIQL algorithm keeps a good balance of exploration and exploitation, which can avoid the local optimal policies and accelerate the learning process as well.Keywords
This publication has 19 references indexed in Scilit:
- Quantum Mechanics Helps in Learning for More Intelligent RobotsChinese Physics Letters, 2006
- QUANTUM GENETIC ALGORITHM METHOD IN SELF-CONSISTENT ELECTRONIC STRUCTURE CALCULATIONS OF A QUANTUM DOT WITH MANY ELECTRONSInternational Journal of Modern Physics C, 2005
- A reinforcement learning with evolutionary state recruitment strategy for autonomous mobile robots controlRobotics and Autonomous Systems, 2004
- Parallelization of a fuzzy control algorithm using quantum computationIEEE Transactions on Fuzzy Systems, 2002
- Fuzzy reinforcement learning control for compliance tasks of robotic manipulatorsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2002
- Quantum artificial neural network architectures and componentsInformation Sciences, 2000
- Quantum associative memoryInformation Sciences, 2000
- Navigation of mobile robots: open questionsRobotica, 2000
- Quantum Mechanics Helps in Searching for a Needle in a HaystackPhysical Review Letters, 1997
- Quantum computation and Shor's factoring algorithmReviews of Modern Physics, 1996