On the Functional Equivalence of TSK Fuzzy Systems to Neural Networks, Mixture of Experts, CART, and Stacking Ensemble Regression
- 16 September 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 28 (10) , 2570-2580
Abstract
Fuzzy systems have achieved great success in numerous applications. However, there are still many challenges in designing an optimal fuzzy system, e.g., how to efficiently optimize its parameters, how to balance the trade-off between cooperations and competitions among the rules, how to overcome the curse of dimensionality, how to increase its generalization ability, etc. Literature has shown that by making appropriate connections between fuzzy systems and other machine learning approaches, good practices from other domains may be used to improve the fuzzy systems, and vice versa. This paper gives an overview on the functional equivalence between Takagi-Sugeno-Kang fuzzy systems and four classic machine learning approaches – neural networks, mixture of experts, classification and regression trees, and stacking ensemble regression – for regression problems. We also point out some promising new research directions, inspired by the functional equivalence, that could lead to solutions to the aforementioned problems. To our knowledge, this is so far the most comprehensive overview on the connections between fuzzy systems and other popular machine learning approaches, and hopefully will stimulate more hybridization between different machine learning algorithms.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61873321)
- International Science and Technology Cooperation Programme (2017YFE0128300)
- 111 Project on Computational Intelligence and Intelligent Control (B18024)
This publication has 63 references indexed in Scilit:
- Genetic learning and performance evaluation of interval type-2 fuzzy logic controllersEngineering Applications of Artificial Intelligence, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Improving the interpretability of TSK fuzzy models by combining global learning and local learningIEEE Transactions on Fuzzy Systems, 1998
- An online self-constructing neural fuzzy inference network and its applicationsIEEE Transactions on Fuzzy Systems, 1998
- Treed RegressionJournal of Computational and Graphical Statistics, 1996
- Learning and tuning fuzzy logic controllers through reinforcementsIEEE Transactions on Neural Networks, 1992
- Universal Approximation Using Radial-Basis-Function NetworksNeural Computation, 1991
- Adaptive Mixtures of Local ExpertsNeural Computation, 1991
- Fast Learning in Networks of Locally-Tuned Processing UnitsNeural Computation, 1989
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970