Anytime Learning and Adaptation of Structured Fuzzy Behaviors
- 1 January 1997
- journal article
- Published by SAGE Publications in Adaptive Behavior
- Vol. 5 (3-4) , 281-315
Abstract
We present an approach to support effective learning and adaptation of behaviors for autonomous agents with reinforcement learning algorithms. These methods can identify control systems that optimize a reinforcement program, which is, usually, a straightforward representation of the designer's goals. Reinforcement learning algorithms usually are too slow to be applied in real time on embodied agents, although they provide a suitable way to represent the desired behavior. We have tackled three aspects of this problem: the speed of the algorithm, the learning procedure, and the control system architecture. The learning algorithm we have developed includes features to speed up learning, such as niche-based learning, and a representation of the control modules in terms of fuzzy rules that reduces the search space and improves robustness to noisy data. Our learning procedure exploits methodologies such as learning from easy missions and transfer of policy from simpler environments to the more complex. The architecture of our control system is layered and modular, so that each module has a low complexity and can be learned in a short time. The composition of the actions proposed by the modules is either learned or predefined. Finally, we adopt an anytime learning approach to improve the quality of the control system on-line and to adapt it to dynamic environments.Keywords
This publication has 19 references indexed in Scilit:
- Designing and Understanding Adaptive Group BehaviorAdaptive Behavior, 1995
- A multivalued logic approach to integrating planning and controlArtificial Intelligence, 1995
- Robot shaping: developing autonomous agents through learningArtificial Intelligence, 1994
- ZCS: A Zeroth Level Classifier SystemEvolutionary Computation, 1994
- Behavior-Based Robot Navigation for Extended DomainsAdaptive Behavior, 1992
- Automatic programming of behavior-based robots using reinforcement learningArtificial Intelligence, 1992
- Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional mapsIEEE Transactions on Neural Networks, 1992
- Classifier systems and genetic algorithmsArtificial Intelligence, 1989
- A robust layered control system for a mobile robotIEEE Journal on Robotics and Automation, 1986
- Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectorsBiological Cybernetics, 1976