An improved index for clustering validation based on Silhouette index and Calinski-Harabasz index
Authors:
- Xu WangXWXu Wang
- Yusheng XuYXYusheng Xu
Open Access
- 1 July 2019
- conference paper
- Published by IOP Publishing in IOP Conference Series: Materials Science and Engineering
- Vol. 569 (5)
Abstract
The evaluation of clustering effects has been an important issue for a long time. How to effectively evaluate the clustering results of clustering algorithms is the key to the problem. The clustering effect evaluation is generally divided into internal clustering effect evaluation and external clustering effect evaluation. This paper focuses on the internal clustering effect evaluation, and proposes an improved index based on the Silhouette index and the Calinski-Harabasz index: Peak Weight Index (PWI). PWI combines the characteristics of Silhouette index and Calinski-Harabasz index, and takes the peak value of the two indexes as the impact point and gives appropriate weight within a certain range. Silhouette index and Calinski-Harabasz index will help improve the fluctuation of clustering results in the data set. Through the simulation experiments on four self-built influence data sets and two real data sets, it will prove that the PWI has excellent evaluation of clustering results.Keywords
This publication has 17 references indexed in Scilit:
- Improving fuzzy c-means clustering based on feature-weight learningPattern Recognition Letters, 2004
- K-means Iterative Fisher (KIF) unsupervised clustering algorithm applied to image texture segmentationPattern Recognition, 2002
- Outlier detection for high dimensional dataACM SIGMOD Record, 2001
- Applied Multivariate TechniquesTechnometrics, 1997
- Estimation of the intraclass correlation coefficientAnnals of Human Genetics, 1993
- A validity measure for fuzzy clusteringIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- The Fowlkes–Mallows Statistic and the Comparison of Two Independently Determined DendrogramsCanadian Journal of Fisheries and Aquatic Sciences, 1988
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987
- Partition coefficient to measure bioconcentration potential of organic chemicals in fishEnvironmental Science & Technology, 1974
- A dendrite method for cluster analysisCommunications in Statistics, 1974