Comparison of scaling behavior between fuzzy c-means based classifier with many parameters and LibSVM
Authors:
- 1 June 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10987584,p. 386-393
Abstract
This paper reports the scaling behavior of the fuzzy c-means based classifier (FCMC) with many parameters. FCMC is a classifier based on clustering approaches. The classification accuracy on test sets (i.e., the generalization capability) is not necessarily improved by increasing the number of clusters. Especially when the number of training samples is relatively small, not only the classification boundary over-fits the data, but also covariance matrices and cluster centers are computed incorrectly, since the number of samples in each cluster becomes smaller. Hence, the test set accuracy deteriorates. The performance of FCMC with two clusters in each class and the number of training samples less than 1000, was reported in the literature. This paper reports the scaling behavior of FCMC by testing with variously-sized training samples. The number of clusters of FCMC is increased up to eight. The number of clusters used in this paper is not very large but the number of parameters is relatively large. So, the parameters are optimized to training sets. LibSVM is one of the widely known state of the art tools for support vector machines (SVM). The test set accuracy, training time and testing time (i.e., the detection time) of FCMC are compared with LibSVM by varying the size of training sets. FCMC shows a good generalization capability, though the parameters are optimized to training sets. When the number of training samples is increased by 10 times, the training time of FCMC increases by 10 times, but that of LibSVM increases by a factor of 100. The testing time is also much shorter than LibSVM when the size of the training set is large.Keywords
This publication has 10 references indexed in Scilit:
- Improvement in the performance of camera based vehicle detector for parking lot2010
- Semi-hard c-means clustering with application to classifier design2010
- Triplet of FCM classifiers2009
- Fuzzy c-means classifier with particle swarm optimization2008
- A Family of Fuzzy and Defuzzified c-Means Algorithms2006
- Particle Swarm Optimization2006
- Fuzzy c-means clustering with regularization by K-L information2005
- A new optimizer using particle swarm theory2002
- Mixtures of Probabilistic Principal Component AnalyzersNeural Computation, 1999
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998