Meta Clustering
Authors:
- 1 December 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE International Conference on Data Mining (ICDM)
- No. 15504786,p. 107-118
Abstract
Clustering is ill-defined. Unlike supervised learning where labels lead to crisp performance criteria such as accuracy and squared error, clustering quality depends on how the clusters will be used. Devising clustering criteria that capture what users need is difficult. Most clustering algorithms search for optimal clusterings based on a pre-specified clustering criterion. Our approach differs. We search for many alternate clusterings of the data, and then allow users to select the clustering(s) that best fit their needs. Meta clustering first finds a variety of clusterings and then clusters this diverse set of clusterings so that users must only examine a small number of qualitatively different clusterings. We present methods for automatically generating a diverse set of alternate clusterings, as well as methods for grouping clusterings into meta clusters. We evaluate meta clustering on four test problems and two case studies. Surprisingly, clusterings that would be of most interest to users often are not very compact clusterings.Keywords
This publication has 10 references indexed in Scilit:
- Meta ClusteringIEEE International Conference on Data Mining (ICDM), 2006
- A new approach to data driven clustering2006
- Clustering Aggregation2005
- Integrating microarray data by consensus clustering2004
- Solving cluster ensemble problems by bipartite graph partitioning2004
- Entropy-based gene ranking without selection bias for the predictive classification of microarray dataBMC Bioinformatics, 2003
- Consensus Clustering: A Resampling-Based Method for Class Discovery and Visualization of Gene Expression Microarray DataMachine Learning, 2003
- Comparing partitionsJournal of Classification, 1985
- Objective Criteria for the Evaluation of Clustering MethodsJournal of the American Statistical Association, 1971
- A General Theory of Classificatory Sorting Strategies: 1. Hierarchical SystemsThe Computer Journal, 1967