Graphical model-based clustering of categorical data
Preprint
Abstract
Clustering multivariate data is a pervasive task in many applied problems, particularly in social studies and life science. Model-based approaches to clustering rely on mixture models, where each mixture component corresponds to the kernel of a distribution characterizing a latent sub-group. Current methods developed within this framework employ multivariate distributions built under the assumption of independence among variables given the cluster allocation. Accordingly, possible dependence structures characterizing differences across groups are not directly accounted for during the clustering process. In this paper we consider multivariate categorical data, and introduce a model-based clustering method which employs graphical models as a tool to encode dependencies between variables. Specifically, we consider a Dirichlet Process mixture of categorical graphical models, which clusters individuals into groups that are homogeneous in terms of dependence (graphical) structure and allied parameters. We provide full Bayesian inference for the model and develop a Markov chain Monte Carlo scheme for posterior analysis. Our method is evaluated through simulations and applied to real case studies, including the analysis of genomic data and voting records. Results reveal the merits of a graphical model-based clustering, in comparison with approaches that do not explicitly account for dependencies in the multivariate distribution of variables.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Model-Based Clustering of Categorical Data Based on the Hamming DistanceJournal of the American Statistical Association, 2024
- Equivalence class selection of categorical graphical modelsComputational Statistics & Data Analysis, 2021
- Bayesian Cluster Analysis: Point Estimation and Credible Balls (with Discussion)Bayesian Analysis, 2018
- From genome-wide associations to candidate causal variants by statistical fine-mappingNature Reviews Genetics, 2018
- Sparse covariance estimation in heterogeneous samplesElectronic Journal of Statistics, 2011
- Variational Bayesian learning of directed graphical models with hidden variablesBayesian Analysis, 2006
- Variational inference for Dirichlet process mixturesBayesian Analysis, 2006
- Bayesian Analysis of Haplotypes for Linkage Disequilibrium MappingGenome Research, 2001
- Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical ValuesData Mining and Knowledge Discovery, 1998
- Identification of the Cystic Fibrosis Gene: Genetic AnalysisScience, 1989