Rapid, safe, and incremental learning of navigation strategies
- 1 June 1996
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Vol. 26 (3) , 408-420
Abstract
In this paper we propose a reinforcement connectionist learning architecture that allows an autonomous robot to acquire efficient navigation strategies in a few trials. Besides rapid learning, the architecture has three further appealing features. First, the robot improves its performance incrementally as it interacts with an initially unknown environment, and it ends up learning to avoid collisions even in those situations in which its sensors cannot detect the obstacles. This is a definite advantage over nonlearning reactive robots. Second, since it learns from basic reflexes, the robot is operational from the very beginning and the learning process is safe. Third, the robot exhibits high tolerance to noisy sensory data and good generalization abilities. All these features make this learning robot's architecture very well suited to real-world applications. We report experimental results obtained with a real mobile robot in an indoor environment that demonstrate the appropriateness of our approach to real autonomous robot control.Keywords
This publication has 23 references indexed in Scilit:
- Robot shaping: developing autonomous agents through learningArtificial Intelligence, 1994
- On the Convergence of Stochastic Iterative Dynamic Programming AlgorithmsNeural Computation, 1994
- Integration of representation into goal-driven behavior-based robotsIEEE Transactions on Robotics and Automation, 1992
- A mobile robot exploration algorithmIEEE Transactions on Robotics and Automation, 1992
- Robot Motion Planning: A Distributed Representation ApproachThe International Journal of Robotics Research, 1991
- Integrating reaction and planning in a heterogeneous asynchronous architecture for mobile robot navigationACM SIGART Bulletin, 1991
- Adaptive Mixtures of Local ExpertsNeural Computation, 1991
- Internalized plans: A representation for action resourcesRobotics and Autonomous Systems, 1990
- Integrating behavioral, perceptual, and world knowledge in reactive navigationRobotics and Autonomous Systems, 1990
- Real-Time Obstacle Avoidance for Manipulators and Mobile RobotsThe International Journal of Robotics Research, 1986