Approximate kernel k-means
Open Access
- 21 August 2011
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 895-903
Abstract
Digital data explosion mandates the development of scalable tools to organize the data in a meaningful and easily accessible form. Clustering is a commonly used tool for data organization. However, many clustering algorithms designed to handle large data sets assume linear separability of data and hence do not perform well on real world data sets. While kernel-based clustering algorithms can capture the non-linear structure in data, they do not scale well in terms of speed and memory requirements when the number of objects to be clustered exceeds tens of thousands. We propose an approximation scheme for kernel k-means, termed approximate kernel k-means, that reduces both the computational complexity and the memory requirements by employing a randomized approach. We show both analytically and empirically that the performance of approximate kernel k-means is similar to that of the kernel k-means algorithm, but with dramatically reduced run-time complexity and memory requirements.Keywords
This publication has 28 references indexed in Scilit:
- Spectral methods in machine learning and new strategies for very large datasetsProceedings of the National Academy of Sciences, 2009
- Evaluation of the performance of clustering algorithms in kernel-induced feature spacePattern Recognition, 2005
- Cluster analysis for gene expression data: a surveyIEEE Transactions on Knowledge and Data Engineering, 2004
- Clustering data streams: theory and practiceIEEE Transactions on Knowledge and Data Engineering, 2003
- Cure: an efficient clustering algorithm for large databasesInformation Systems, 2001
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Large-scale parallel data clusteringIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Incremental clustering for very large document databases: Initial MARIAN ExperienceInformation Sciences, 1995
- Comparing partitionsJournal of Classification, 1985