Modal clustering in a class of product partition models
Author:
- David B. DahlDDDavid B. Dahl
Open Access
- 1 June 2009
- journal article
- research article
- Published by Institute of Mathematical Statistics in Bayesian Analysis
- Vol. 4 (2) , 243-264
Abstract
This paper defines a class of univariate product partition models for which a novel deterministic search algorithm is guaranteed to find the maximum a posteriori (MAP) clustering or the maximum likelihood (ML) clustering. While the number of possible clusterings of $n$ items grows exponentially according to the Bell number, the proposed mode-finding algorithm exploits properties of the model to provide a search requiring only $n(n+1)$ computations. No Monte Carlo is involved. Thus, the algorithm finds the MAP or ML clustering for potentially tens of thousands of items, whereas it can only be approximated through a stochastic search. Integrating over the model parameters in a Dirichlet process mixture (DPM) model leads to a product partition model. A simulation study explores the quality of the clustering estimates despite departures from the assumptions. Finally, applications to three specific models --- clustering means, probabilities, and variances --- are used to illustrate the variety of applicable models and mode-finding algorithm.
Keywords
This publication has 30 references indexed in Scilit:
- Bayesian Model-Based Clustering ProceduresJournal of Computational and Graphical Statistics, 2007
- Model-Based Clustering for Expression Data via a Dirichlet Process Mixture Model2006
- Bayesian Clustering and Product Partition ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2003
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determinationBiometrika, 1995
- Estimating normal means with a conjugate style dirichlet process priorCommunications in Statistics - Simulation and Computation, 1994
- Product Partition Models for Change Point ProblemsThe Annals of Statistics, 1992
- Partition modelsCommunications in Statistics - Theory and Methods, 1990
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- The Number of Partitions of a SetThe American Mathematical Monthly, 1964
- Exponential NumbersThe American Mathematical Monthly, 1934