Cluster Differences Scaling with a Within-Clusters Loss Component and a Fuzzy Successive Approximation Strategy to Avoid Local Minima
- 1 March 1997
- journal article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 62 (1) , 63-83
Abstract
Cluster differences scaling is a method for partitioning a set of objects into classes and simultaneously finding a low-dimensional spatial representation of K cluster points, to model a given square table of dissimilarities among n stimuli or objects. The least squares loss function of cluster differences scaling, originally defined only on the residuals of pairs of objects that are allocated to different clusters, is extended with a loss component for pairs that are allocated to the same cluster. It is shown that this extension makes the method equivalent to multidimensional scaling with cluster constraints on the coordinates. A decomposition of the sum of squared dissimilarities into contributions from several sources of variation is described, including the appropriate degrees of freedom for each source. After developing a convergent algorithm for fitting the cluster differences model, it is argued that the individual objects and the cluster locations can be jointly displayed in a configuration obtained as a by-product of the optimization. Finally, the paper introduces a fuzzy version of the loss function, which can be used in a successive approximation strategy for avoiding local minima. A simulation study demonstrates that this strategy significantly outperforms two other well-known initialization strategies, and that it has a success rate of 92 out of 100 in attaining the global minimum.Keywords
This publication has 20 references indexed in Scilit:
- Clustering in Low-Dimensional Space1993
- On the Interface between Cluster Analysis, Principal Component Analysis, and Multidimensional Scaling1987
- Pattern Recognition with Fuzzy Objective Function Algorithms1981
- Fuzzy Sets and Their Application to Pattern Classification and Clustering Analysis1977
- The Relationship between Multidimensional Scaling and Clustering1977
- Spatial Interaction PatternsJournal of Environmental Systems, 1976
- Linear Statistical Inference and its Applications1973
- An Efficient Heuristic Procedure for Partitioning GraphsBell System Technical Journal, 1970
- A clustering technique for summarizing multivariate dataSystems Research and Behavioral Science, 1967
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMSAnnals of Eugenics, 1936