Multidimensional Scaling With Heaviside Weighting: Extensions to Curvilinear Component Analysis and Curvilinear Distance Analysis
Author:
Open Access
Abstract
In this article, I propose extensions to multidimensional scaling (MDS) variants that use Heaviside weighting for manifold learning, namely, curvilinear component analysis and curvilinear distance analysis. These methods weight the approximation error with a Heaviside function to ignore larger fitted distances in the configuration, thus effectively providing a localized version of MDS. I extend these methods with (i) optimal scaling that allows for linear, affine or spline transformations of the proximities and (ii) fitting power transformations of proximities and distances. I suggest a quasi‐MM algorithm for optimization and present the methods either for a fixed neighbourhood parameter or as self‐organizing. I employ both geodesic distances and arbitrary dissimilarities as proximities. This yields new MDS variants that I call extended curvilinear component analysis (eCLCA), extended curvilinear power component analysis (eCLPCA), extended curvilinear distance analysis (eCLDA) and extended curvilinear power distance analysis (eCLPDA). With three data examples, I show how the extensions can improve learning a manifold.Keywords
This publication has 15 references indexed in Scilit:
- Cluster Optimized Proximity ScalingJournal of Computational and Graphical Statistics, 2021
- Two-Way Multidimensional Scaling: A ReviewIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2011
- On multidimensional scaling and the embedding of self-organising mapsNeural Networks, 2008
- Nonlinear projection with curvilinear distances: Isomap versus curvilinear distance analysisNeurocomputing, 2004
- Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data setsIEEE Transactions on Neural Networks, 1997
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982
- Maximum Likelihood Estimation in Multidimensional ScalingPsychometrika, 1977
- Nonmetric Individual Differences Multidimensional Scaling: An Alternating Least Squares Method with Optimal Scaling FeaturesPsychometrika, 1977
- A Nonlinear Mapping for Data Structure AnalysisIEEE Transactions on Computers, 1969
- Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric HypothesisPsychometrika, 1964