Estimation of perceptual scales using ordinal embedding
Open Access
- 2 September 2020
- journal article
- research article
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (9) , 14
Abstract
In this article, we address the problem of measuring and analyzing sensation, the subjective magnitude of one’s experience. We do this in the context of the method of triads: The sensation of the stimulus is evaluated via relative judgments of the following form: “Is stimulus Display Formula \(S_i\) more similar to stimulus Display Formula \(S_j\) or to stimulus Display Formula \(S_k\) ?” We propose to use ordinal embedding methods from machine learning to estimate the scaling function from the relative judgments. We review two relevant and well-known methods in psychophysics that are partially applicable in our setting: nonmetric multidimensional scaling (NMDS) and the method of maximum likelihood difference scaling (MLDS). Considering various scaling functions, we perform an extensive set of simulations to demonstrate the performance of the ordinal embedding methods. We show that in contrast to existing approaches, our ordinal embedding approach allows, first, to obtain reasonable scaling functions from comparatively few relative judgments and, second, to estimate multidimensional perceptual scales. In addition to the simulations, we analyze data from two real psychophysics experiments using ordinal embedding methods. Our results show that in the one-dimensional perceptual scale, our ordinal embedding approach works as well as MLDS, while in higher dimensions, only our ordinal embedding methods can produce a desirable scaling function. To make our methods widely accessible, we provide an R-implementation and general rules of thumb on how to use ordinal embedding in the context of psychophysics.
Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- Conjoint Measurement of Gloss and Surface TexturePsychological Science, 2008
- Tuning for shape dimensions in macaque inferior temporal cortexEuropean Journal of Neuroscience, 2005
- Maximum likelihood difference scalingJournal of Vision, 2003
- J. Plateau: On the measurement of physical sensations and on the law which links the intensity of these sensations to the intensity of the sourcePsychological Research, 1996
- Patterns of cognitive appraisal in emotion.Journal of Personality and Social Psychology, 1985
- The measurement of loudness using direct comparisons of sensory intervalsJournal of Mathematical Psychology, 1974
- Nonmetric Multidimensional Scaling: A Numerical MethodPsychometrika, 1964
- Simultaneous conjoint measurement: A new type of fundamental measurementJournal of Mathematical Psychology, 1964
- The derivation of subjective scales from just noticeable differences.Psychological Review, 1958
- A law of comparative judgment.Psychological Review, 1927