A Density Peaks Clustering Algorithm With Sparse Search and K-d Tree
Open Access
- 14 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 74883-74901
Abstract
Density peaks clustering has become a nova of clustering algorithm because of its simplicity and practicality. However, there is one main drawback: it is time-consuming due to its high computational complexity. Herein, a density peaks clustering algorithm with sparse search and K-d tree is developed to solve this problem. Firstly, a sparse distance matrix is calculated by using K-d tree to replace the original full rank distance matrix, so as to accelerate the calculation of local density. Secondly, a sparse search strategy is proposed to accelerate the computation of relative-separation with the intersection between the set of $k$ nearest neighbors and the set consisting of the data points with larger local density for any data point. Furthermore, a second-order difference method for decision values is adopted to determine the cluster centers adaptively. Finally, experiments are carried out on datasets with different distribution characteristics, by comparing with other six state-of-the-art clustering algorithms. It is proved that the algorithm can effectively reduce the computational complexity of the original DPC from $O(n^{2}K)$ to $O(n(n^{1-1/K}+k))$ . Especially for larger datasets, the efficiency is elevated more remarkably. Moreover, the clustering accuracy is also improved to a certain extent. Therefore, it can be concluded that the overall performance of the newly proposed algorithm is excellent.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (51671075, 51971086)
- State Key Laboratory of Solidification Processing in Northwestern Polytechnical University (SKLSP201606)
- Heilongjiang Postdoctoral Fund for scientific research initiation (LBHQ16118)
- fundamental research foundation for universities of heilongjiang province (LGYC2018JC004)
This publication has 44 references indexed in Scilit:
- A fast density-based data stream clustering algorithm with cluster centers self-determined for mixed dataInformation Sciences, 2016
- Clustering by fast search and find of density peaksScience, 2014
- A Survey of Clustering Algorithms for Big Data: Taxonomy and Empirical AnalysisIEEE Transactions on Emerging Topics in Computing, 2014
- Robust path-based spectral clusteringPattern Recognition, 2008
- Mechanical drilling of printed circuit boards: the state‐of‐the‐artCircuit World, 2007
- Clustering aggregationACM Transactions on Knowledge Discovery From Data, 2007
- A maximum variance cluster algorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- A Method for Comparing Two Hierarchical ClusteringsJournal of the American Statistical Association, 1983
- Algorithm AS 136: A K-Means Clustering AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979
- Multidimensional binary search trees used for associative searchingCommunications of the ACM, 1975