Ant Colony Optimization Incorporated With Fuzzy Q-Learning for Reinforcement Fuzzy Control
Authors:
- 27 February 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Vol. 39 (3) , 597-608
Abstract
This paper proposes the design of fuzzy controllers by ant colony optimization (ACO) incorporated with fuzzy-Q learning, called ACO-FQ, with reinforcements. For a fuzzy inference system, we partition the antecedent part a priori and then list all candidate consequent actions of the rules. In ACO-FQ, the tour of an ant is regarded as a combination of consequent actions selected from every rule. Searching for the best one among all combinations is partially based on pheromone trail. We assign to each candidate in the consequent part of the rule a corresponding Q-value. Update of the Q-value is based on fuzzy-Q learning. The best combination of consequent values of a fuzzy inference system is searched according to pheromone levels and Q-values. ACO-FQ is applied to three reinforcement fuzzy control problems: (1) water bath temperature control; (2) magnetic levitation control; and (3) truck backup control. Comparisons with other reinforcement fuzzy system design methods verify the performance of ACO-FQ.Keywords
This publication has 28 references indexed in Scilit:
- Fuzzy Q-learning for generalization of reinforcement learning2002
- Fuzzy Q-learning2002
- Fuzzy inference system learning by reinforcement methodsIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 1998
- Fuzzy Q-learning and dynamical fuzzy Q-learning1994
- Q-learningMachine Learning, 1992
- Generating fuzzy rules by learning from examplesIEEE Transactions on Systems, Man, and Cybernetics, 1992
- Comparison of fuzzy and neural truck backer-upper control systems1990
- Learning to control an inverted pendulum using neural networksIEEE Control Systems Magazine, 1989
- Learning to predict by the methods of temporal differencesMachine Learning, 1988
- Neuronlike adaptive elements that can solve difficult learning control problemsIEEE Transactions on Systems, Man, and Cybernetics, 1983