Improving performance of similarity-based clustering by feature weight learning
Authors:
- X.Z. WangXWX.Z. Wang
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 24 (4) , 556-561
Abstract
Similarity-based clustering is a simple but powerful technique which usually results in a clustering graph for a partitioning of threshold values in the unit interval. The guiding principle of similarity-based clustering is "similar objects are grouped in the same cluster." To judge whether two objects are similar, a similarity measure must be given in advance. The similarity measure presented in the paper is determined in terms of the weighted distance between the features of the objects. Thus, the clustering graph and its performance (which is described by several evaluation indices defined in the paper) will depend on the feature weights. The paper shows that, by using gradient descent technique to learn the feature weights, the clustering performance can be significantly improved. It is also shown that our method helps to reduce the uncertainty (fuzziness and nonspecificity) of the similarity matrix. This enhances the quality of the similarity-based decision making.Keywords
This publication has 12 references indexed in Scilit:
- A survey of fuzzy clustering algorithms for pattern recognition. IIIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1999
- Unsupervised feature selection using a neuro-fuzzy approachPattern Recognition Letters, 1998
- The three semantics of fuzzy setsFuzzy Sets and Systems, 1997
- Weighted fuzzy production rulesFuzzy Sets and Systems, 1997
- A simple but powerful heuristic method for generating fuzzy rules from numerical dataFuzzy Sets and Systems, 1997
- MEASURES OF UNCERTAINTY AND INFORMATION BASED ON POSSIBILITY DISTRIBUTIONSInternational Journal of General Systems, 1982
- Pattern Recognition with Fuzzy Objective Function Algorithms1981
- A definition of a nonprobabilistic entropy in the setting of fuzzy sets theoryInformation and Control, 1972
- Similarity relations and fuzzy orderingsInformation Sciences, 1971
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMSAnnals of Eugenics, 1936