Optimization of Basic Clustering for Ensemble Clustering: An Information-Theoretic Perspective
Open Access
- 29 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 179048-179062
Abstract
The current research on ensemble clustering mainly focuses on integration strategies, but the attention regarding the measurement and optimization of basic cluster is less emphasized. Based on the information entropy theory, this paper proposes a quality metric of basic cluster, and the clusterings are further selected by incorporating two-branch decisions and three-way decisions respectively. Determined by preset threshold(s), mechanism of two-branch based basic clustering filtering (BCF2BD) and three-way based basic clustering filtering (BCF3WD) are developed. Concretely, the basic clustering in BCF2BD is deleted if the quality metric of it is less than the preset threshold ξ, and the new clustering member is added to maintain the basic cluster set count. The basic clustering in BCF3WD is deleted if the quality metric of it is less than the preset threshold β, retained if the quality metric of it is greater than the preset threshold α, recalculated if the quality metric of it is greater than β and less than α. Both mechanism executed repeatedly until either non-decrement of basic clusters occurred or maximum iteration count reached. Contrastive experiments show that both methods of filtering algorithms can effectively improve the performance of ensemble clustering, and the three-way decisions filtering algorithm get less time consumption.Keywords
Funding Information
- National Natural Science Foundation of China (61763031)
This publication has 44 references indexed in Scilit:
- Probabilistic consensus clustering using evidence accumulationMachine Learning, 2013
- A SURVEY OF CLUSTERING ENSEMBLE ALGORITHMSInternational Journal of Pattern Recognition and Artificial Intelligence, 2011
- Three-way decisions with probabilistic rough setsInformation Sciences, 2010
- Clustering aggregation by probability accumulationPattern Recognition, 2009
- Weighted cluster ensemblesACM Transactions on Knowledge Discovery From Data, 2009
- Ensemble clustering with voting active clustersPattern Recognition Letters, 2008
- Combining multiple clusterings using evidence accumulationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- ROUGH SET THEORY AND ITS APPLICATIONS TO DATA ANALYSISCybernetics and Systems, 1998
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982
- Objective Criteria for the Evaluation of Clustering MethodsJournal of the American Statistical Association, 1971