Merging K‐means with hierarchical clustering for identifying general‐shaped groups
Authors:
Abstract
Clustering partitions a dataset such that observations placed together in a group are similar but different from those in other groups. Hierarchical and K‐means clustering are two approaches but have different strengths and weaknesses. For instance, hierarchical clustering identifies groups in a tree‐like structure but suffers from computational complexity in large datasets, while K‐means clustering is efficient but designed to identify homogeneous spherically shaped clusters. We present a hybrid non‐parametric clustering approach that amalgamates the two methods to identify general‐shaped clusters and that can be applied to larger datasets. Specifically, we first partition the dataset into spherical groups using K‐means. We next merge these groups using hierarchical methods with a data‐driven distance measure as a stopping criterion. Our proposal has the potential to reveal groups with general shapes and structure in a dataset. We demonstrate good performance on several simulated and real datasets. Copyright © 2018 John Wiley & Sons, Ltd.Keywords
All Related Versions
Funding Information
- Center for Hierarchical Manufacturing, National Science Foundation (DMS-0707069, DMS-CAREER-0437555)
- National Institutes of Health (R21EB0126212)
This publication has 22 references indexed in Scilit:
- Combining Mixture Components for ClusteringJournal of Computational and Graphical Statistics, 2010
- Tight Clustering: A Resampling‐Based Approach for Identifying Stable and Tight Patterns in DataBiometrics, 2005
- Finding the Number of Clusters in a DatasetJournal of the American Statistical Association, 2003
- Model-Based Clustering, Discriminant Analysis, and Density EstimationJournal of the American Statistical Association, 2002
- Estimating the Number of Clusters in a Data Set Via the Gap StatisticJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- Nearest-Neighbor Clutter Removal for Estimating Features in Spatial Point ProcessesJournal of the American Statistical Association, 1998
- A Criterion for Determining the Number of Groups in a Data Set Using Sum-of-Squares ClusteringBiometrics, 1988
- Statistical theory in clusteringJournal of Classification, 1985
- Comparing partitionsJournal of Classification, 1985
- Algorithm AS 136: A K-Means Clustering AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979