Support-vector-based fuzzy neural network for pattern classification
Authors:
- Chin-Teng LinCLChin-Teng Lin
- Chang-Mao YehCYChang-Mao Yeh
- Sheng-Fu LiangSLSheng-Fu Liang
- Jen-Feng ChungJCJen-Feng Chung
- N. KumarNKN. Kumar
- 13 February 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 14 (1) , 31-41
Abstract
Fuzzy neural networks (FNNs) for pattern classification usually use the backpropagation or C-cluster type learning algorithms to learn the parameters of the fuzzy rules and membership functions from the training data. However, such kinds of learning algorithms usually cannot minimize the empirical risk (training error) and expected risk (testing error) simultaneously, and thus cannot reach a good classification performance in the testing phase. To tackle this drawback, a support-vector-based fuzzy neural network (SVFNN) is proposed for pattern classification in this paper. The SVFNN combines the superior classification power of support vector machine (SVM) in high dimensional data spaces and the efficient human-like reasoning of FNN in handling uncertainty information. A learning algorithm consisting of three learning phases is developed to construct the SVFNN and train its parameters. In the first phase, the fuzzy rules and membership functions are automatically determined by the clustering principle. In the second phase, the parameters of FNN are calculated by the SVM with the proposed adaptive fuzzy kernel function. In the third phase, the relevant fuzzy rules are selected by the proposed reducing fuzzy rule method. To investigate the effectiveness of the proposed SVFNN classification, it is applied to the Iris, Vehicle, Dna, Satimage, Ijcnn1 datasets from the UCI Repository, Statlog collection and IJCNN challenge 2001, respectively. Experimental results show that the proposed SVFNN for pattern classification can achieve good classification performance with drastically reduced number of fuzzy kernel functions.Keywords
This publication has 33 references indexed in Scilit:
- A comparison of methods for multiclass support vector machinesIEEE Transactions on Neural Networks, 2002
- An efficient fuzzy classifier with feature selection based on fuzzy entropyIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2001
- Input space versus feature space in kernel-based methodsIEEE Transactions on Neural Networks, 1999
- Fuzzy classifications using fuzzy inference networksIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1998
- Constructive training of probabilistic neural networksNeurocomputing, 1998
- An online self-constructing neural fuzzy inference network and its applicationsIEEE Transactions on Fuzzy Systems, 1998
- Adaptive fuzzy rule-based classification systemsIEEE Transactions on Fuzzy Systems, 1996
- Modeling and control of carbon monoxide concentration using a neuro-fuzzy techniqueIEEE Transactions on Fuzzy Systems, 1995
- Learning control using fuzzified self-organizing radial basis function networkIEEE Transactions on Fuzzy Systems, 1993
- A Resource-Allocating Network for Function InterpolationNeural Computation, 1991