Structure-based hyperparameter selection with Bayesian optimization in multidimensional scaling
Open Access
- 26 December 2022
- journal article
- research article
- Published by Springer Nature in Statistics and Computing
- Vol. 33 (1) , 1-18
Abstract
We introduce the structure optimized proximity scaling (STOPS) framework for hyperparameter selection in parametrized multidimensional scaling and extensions (proximity scaling; PS). The selection process for hyperparameters is based on the idea that we want the configuration to show a certain structural quality (c-structuredness). A number of structures and how to measure them are discussed. We combine the structural quality by means of c-structuredness indices with the PS badness-of-fit measure in a multi-objective scalarization approach, yielding the Stoploss objective. Computationally we suggest a profile-type algorithm that first solves the PS problem and then uses Stoploss in an outer step to optimize over the hyperparameters. Bayesian optimization with treed Gaussian processes as a an apt and efficient strategy for carrying out the outer optimization is recommended. This way, hyperparameter tuning for many instances of PS is covered in a single conceptual framework. We illustrate the use of the STOPS framework with three data examples.Keywords
Funding Information
- Vienna University of Economics and Business
This publication has 38 references indexed in Scilit:
- Local Multidimensional Scaling for Nonlinear Dimension Reduction, Graph Drawing, and Proximity AnalysisJournal of the American Statistical Association, 2009
- Bayesian Treed Gaussian Process Models With an Application to Computer ModelingJournal of the American Statistical Association, 2008
- Data Visualization With Multidimensional ScalingJournal of Computational and Graphical Statistics, 2008
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data setsIEEE Transactions on Neural Networks, 1997
- Estimating Optimal Transformations for Multiple Regression and CorrelationJournal of the American Statistical Association, 1985
- Optimization by Simulated AnnealingScience, 1983
- Some Statistical Approaches to Multidimensional Scaling DataJournal of the Royal Statistical Society. Series A (General), 1982
- Optimization by direct search and systematic reduction of the size of search regionAIChE Journal, 1973
- THE MULTIDIMENSIONAL ANALYSIS OF ‘ELASTIC’ DISTANCESBritish Journal of Mathematical and Statistical Psychology, 1966