Integrating Clustering and Supervised Learning for Categorical Data Analysis
- 1 April 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Vol. 40 (4) , 664-675
Abstract
The problem of fuzzy clustering of categorical data, where no natural ordering among the elements of a categorical attribute domain can be found, is an important problem in exploratory data analysis. As a result, a few clustering algorithms with focus on categorical data have been proposed. In this paper, a modified differential evolution (DE)-based fuzzy c-medoids (FCMdd) clustering of categorical data has been proposed. The algorithm combines both local as well as global information with adaptive weighting. The performance of the proposed method has been compared with those using genetic algorithm, simulated annealing, and the classical DE technique, besides the FCMdd, fuzzy k-modes, and average linkage hierarchical clustering algorithm for four artificial and four real life categorical data sets. Statistical test has been carried out to establish the statistical significance of the proposed method. To improve the result further, the clustering method is integrated with a support vector machine (SVM), a well-known technique for supervised learning. A fraction of the data points selected from different clusters based on their proximity to the respective medoids is used for training the SVM. The clustering assignments of the remaining points are thereafter determined using the trained classifier. The superiority of the integrated clustering and supervised learning approach has been demonstrated.Keywords
This publication has 23 references indexed in Scilit:
- A Simulated Annealing-Based Multiobjective Optimization Algorithm: AMOSAIEEE Transactions on Evolutionary Computation, 2008
- Interactive Particle Swarm: A Pareto-Adaptive Metaheuristic to Multiobjective OptimizationIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2008
- Automatic Clustering Using an Improved Differential Evolution AlgorithmIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2007
- Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color SegmentationIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2007
- Using one-class and two-class SVMs for multiclass image annotationIEEE Transactions on Knowledge and Data Engineering, 2005
- Fuzzy partitioning using a real-coded variable-length genetic algorithm for pixel classificationIEEE Transactions on Geoscience and Remote Sensing, 2003
- Nonparametric genetic clustering: comparison of validity indicesIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2001
- Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous SpacesJournal of Global Optimization, 1997
- Optimization by Simulated AnnealingScience, 1983
- Constrained Optimization of Functionals with Search Theory ApplicationsMathematics of Operations Research, 1981