Maximum Likelihood Estimation for Single Linkage Hierarchical Clustering
Authors:
Preprint
Abstract
We derive a statistical model for estimation of a dendrogram from single linkage hierarchical clustering (SLHC) that takes account of uncertainty through noise or corruption in the measurements of separation of data. Our focus is on just the estimation of the hierarchy of partitions afforded by the dendrogram, rather than the heights in the latter. The concept of estimating this "dendrogram structure'' is introduced, and an approximate maximum likelihood estimator (MLE) for the dendrogram structure is described. These ideas are illustrated by a simple Monte Carlo simulation that, at least for small data sets, suggests the method outperforms SLHC in the presence of noise.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Statistical properties of the single linkage hierarchical clustering estimatorJournal of Statistical Planning and Inference, 2017
- Classifying Clustering SchemesFoundations of Computational Mathematics, 2013
- Juxtapp: A Scalable System for Detecting Code Reuse among Android Applications2013
- Social Network Analysis of a Criminal Hacker CommunityJournal of Computer Information Systems, 2010
- Maximum entropy Gaussian approximations for the number of integer points and volumes of polytopesAdvances in Applied Mathematics, 2010
- Hybrid hierarchical clustering with applications to microarray dataBiostatistics, 2005
- Probability distribution of molecular evolutionary trees: A new method of phylogenetic inferenceJournal of Molecular Evolution, 1996
- Maximum likelihood phylogenetic estimation from DNA sequences with variable rates over sites: Approximate methodsJournal of Molecular Evolution, 1994
- Evolutionary trees from DNA sequences: A maximum likelihood approachJournal of Molecular Evolution, 1981
- Estimating Phylogenetic Trees from Distance MatricesThe American Naturalist, 1972