Deterministic Annealing Approach to Fuzzy C-Means Clustering Based on Entropy Maximization
Author:
Open Access
- 20 November 2011
- journal article
- research article
- Published by Hindawi Limited in Advances in Fuzzy Systems
- Vol. 2011, 1-9
Abstract
This paper is dealing with the fuzzy clustering method which combines the deterministic annealing (DA) approach with an entropy, especially the Shannon entropy and the Tsallis entropy. By maximizing the Shannon entropy, the fuzzy entropy, or the Tsallis entropy within the framework of the fuzzy c-means (FCM) method, membership functions similar to the statistical mechanical distribution functions are obtained. We examine characteristics of these entropy-based membership functions from the statistical mechanical point of view. After that, both the Shannon- and Tsallis-entropy-based FCMs are formulated as DA clustering using the very fast annealing (VFA) method as a cooling schedule. Experimental results indicate that the Tsallis-entropy-based FCM is stable with very fast deterministic annealing and suitable for this annealing process.Keywords
This publication has 7 references indexed in Scilit:
- Entropy based Fuzzy c-means Clustering : Analogy with Statistical MechanicsJournal of Japan Society for Fuzzy Theory and Intelligent Informatics, 2005
- Possibilistic and probabilistic fuzzy clustering: unification within the framework of the non-extensive thermostatisticsPattern Recognition, 2003
- A deterministic annealing approach to clusteringPattern Recognition Letters, 1990
- Possible generalization of Boltzmann-Gibbs statisticsJournal of Statistical Physics, 1988
- Fast simulated annealingPhysics Letters A, 1987
- Optimization by Simulated AnnealingScience, 1983
- A definition of a nonprobabilistic entropy in the setting of fuzzy sets theoryInformation and Control, 1972