An Information-Theoretical Framework for Cluster Ensemble
- 17 August 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. PP (10414347) , 1
Abstract
Cluster ensemble is a very important tool that aggregates several base clusterings to generate a single output clustering with improved robustness and stability. However, the quality of the final clustering is often affected by uncertainties on the generation and integration of base clusterings. In this paper, we develop an information-theoretical framework which makes an effort to obtain a final clustering with high consensus on both the original data set and the base clustering set by minimizing the two uncertainties of cluster ensemble. In this framework, we provide a weighted consensus measure based on information entropy to evaluate the quality of a clustering, the similarity between clusters and the similarity between objects. Based on the measure, we propose three weighted cluster ensemble algorithms with different ensemble strategies in the framework, including the weighted feature consensus algorithm, the weighted relabeling consensus algorithm and the weighted pairwise-similarity consensus algorithm. In the experimental analysis, we compare the proposed algorithms with other existing clustering ensemble algorithms on several data sets. The comparison results illustrate the proposed algorithms are very effective and robust.Keywords
This publication has 44 references indexed in Scilit:
- Combining multiple clusterings using similarity graphPattern Recognition, 2011
- Bayesian cluster ensemblesStatistical Analysis and Data Mining: An ASA Data Science Journal, 2011
- A scalable framework for cluster ensemblesPattern Recognition, 2009
- Unsupervised feature selection using clustering ensembles and population based incremental learning algorithmPattern Recognition, 2008
- An information-theoretic framework for resolving community structure in complex networksProceedings of the National Academy of Sciences, 2007
- Clustering aggregationACM Transactions on Knowledge Discovery From Data, 2007
- Combining multiple clusterings using evidence accumulationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Objective Criteria for the Evaluation of Clustering MethodsJournal of the American Statistical Association, 1971