The Global Kernel $k$-Means Algorithm for Clustering in Feature Space
- 29 May 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 20 (7) , 1181-1194
Abstract
Kernel k-means is an extension of the standard k-means clustering algorithm that identifies nonlinearly separable clusters. In order to overcome the cluster initialization problem associated with this method, we propose the global kernel k-means algorithm, a deterministic and incremental approach to kernel-based clustering. Our method adds one cluster at each stage, through a global search procedure consisting of several executions of kernel k-means from suitable initializations. This algorithm does not depend on cluster initialization, identifies nonlinearly separable clusters, and, due to its incremental nature and search procedure, locates near-optimal solutions avoiding poor local minima. Furthermore, two modifications are developed to reduce the computational cost that do not significantly affect the solution quality. The proposed methods are extended to handle weighted data points, which enables their application to graph partitioning. We experiment with several data sets and the proposed approach compares favorably to kernel k-means with random restarts.Keywords
This publication has 18 references indexed in Scilit:
- Modified global -means algorithm for minimum sum-of-squares clustering problemsPattern Recognition, 2008
- A survey of kernel and spectral methods for clusteringPattern Recognition, 2008
- Clustering by Passing Messages Between Data PointsScience, 2007
- Kernel Principle Component Analysis in Pixels Clustering2005
- Information Theory and Statistics: A TutorialFoundations and Trends® in Communications and Information Theory, 2004
- Kernel k-means2004
- A large scale clustering scheme for kernel K-Means2003
- Multiclass spectral clustering2003
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998