Summarizing Finite Mixture Model with Overlapping Quantification
Open Access
Abstract
Finite mixture models are widely used for modeling and clustering data. When they are used for clustering, they are often interpreted by regarding each component as one cluster. However, this assumption may be invalid when the components overlap. It leads to the issue of analyzing such overlaps to correctly understand the models. The primary purpose of this paper is to establish a theoretical framework for interpreting the overlapping mixture models by estimating how they overlap, using measures of information such as entropy and mutual information. This is achieved by merging components to regard multiple components as one cluster and summarizing the merging results. First, we propose three conditions that any merging criterion should satisfy. Then, we investigate whether several existing merging criteria satisfy the conditions and modify them to fulfill more conditions. Second, we propose a novel concept named clustering summarization to evaluate the merging results. In it, we can quantify how overlapped and biased the clusters are, using mutual information-based criteria. Using artificial and real datasets, we empirically demonstrate that our methods of modifying criteria and summarizing results are effective for understanding the cluster structures. We therefore give a new view of interpretability/explainability for model-based clustering.Keywords
Funding Information
- Japan Science and Technology Agency (JST-AIP JPMJCR19U4)
- Japan Society for the Promotion of Science (JST KAKENHI JP19H01114)
This publication has 37 references indexed in Scilit:
- Combining Mixture Components for ClusteringJournal of Computational and Graphical Statistics, 2010
- Parametric Embedding for Class VisualizationNeural Computation, 2007
- Clustering Based on a Multilayer Mixture ModelJournal of Computational and Graphical Statistics, 2005
- Assessing a mixture model for clustering with the integrated completed likelihoodIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- A theory of proximity based clustering: structure detection by optimizationPattern Recognition, 2000
- How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster AnalysisThe Computer Journal, 1998
- Comparing partitionsJournal of Classification, 1985
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- Hierarchical Grouping to Optimize an Objective FunctionJournal of the American Statistical Association, 1963
- On the Use of Discriminant Functions in TaxonomyBiometrics, 1962