Adaptive Consensus Clustering for Multiple K-Means Via Base Results Refining
- 6 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 35 (10) , 10251-10264
Abstract
Consensus clustering, which learns a consensus clustering result from multiple weak base results, has been widely studied. However, conventional consensus clustering methods only focus on the ensemble process while ignoring the quality improvement of the base results, and thus they just use the fixed base results for consensus learning. In this paper, we provide an alternative idea to improve the final consensus clustering performance by considering the base results refining. In our framework, we adaptively refine the base results in the process of the ensemble. In more detail, on one hand, we ensemble multiple K-means results to learn the consensus one by considering the consensus and diversity; on the other hand, we apply the consensus result to design a graph filter to learn a more cluster-friendly embedding for refining the base K-means results. In our framework, the consensus learning and base results refining are integrated into one unified objective function so that these two tasks can be boosted by each other. Then we design an effective iterative algorithm to optimize the carefully designed objective function. The extensive experiments on benchmark data sets demonstrate that the proposed method can outperform both the single clustering and the state-of-the-art consensus clustering methods. The codes of this paper are released in http://Doctor-Nobody.github.io/codes/ACMK.zip .Keywords
Funding Information
- National Natural Science Foundation of China (62176001, 61806003, 61976129, 61972001)
This publication has 49 references indexed in Scilit:
- Spectral Ensemble Clustering2015
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- A scalable framework for cluster ensemblesPattern Recognition, 2009
- Weighted Consensus Clustering2008
- Regularized locality preserving indexing via spectral regression2007
- Clusterer ensembleKnowledge-Based Systems, 2006
- Solving cluster ensemble problems by bipartite graph partitioning2004
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Optimal discriminant plane for a small number of samples and design method of classifier on the planePattern Recognition, 1991
- On the limited memory BFGS method for large scale optimizationMathematical Programming, 1989