The Effect of Visual and Auditory Information on the Perception of Pleasantness and Roughness of Virtual Surfaces
- 1 January 2018
- journal article
- research article
- Published by Walter de Gruyter GmbH in Multisensory Research
- Vol. 31 (6) , 501-522
Abstract
Despite the large number of studies on the multisensory aspects of tactile perception, very little is known regarding the effects of visual and auditory sensory modalities on the tactile hedonic evaluation of textures, especially when the presentation of the stimuli is mediated by a haptic device. In this study, different haptic virtual surfaces were rendered by varying the static and dynamic frictional coefficients of a Geomagic®Touch device. In Experiment 1, the haptic surfaces were paired with pictures representing everyday materials (glass, plastic, rubber and steel); in Experiment 2, the haptic surfaces were paired with sounds resulting from the haptic exploration of paper or sandpaper. In both the experiments, participants were required to rate the pleasantness and the roughness of the virtual surfaces explored. Exploration times were also recorded. Both pleasantness and roughness judgments, as well as the durations of exploration, varied as a function of the combinations of the visuo-tactile and the audio-tactile stimuli presented. Taken together, these results suggest that vision and audition modulate haptic perception and hedonic preferences when tactile sensations are provided through a haptic device. Importantly, these results offer interesting suggestions for designing more pleasant, and even more realistic, multisensory virtual surfaces.Keywords
This publication has 54 references indexed in Scilit:
- The development and validation of sensory and emotional scales of touch perceptionAttention, Perception, & Psychophysics, 2010
- Quantitative assessment of pleasant touchNeuroscience & Biobehavioral Reviews, 2010
- Multisensory integration: current issues from the perspective of the single neuronNature Reviews Neuroscience, 2008
- The perceived roughness of resistive virtual texturesACM Transactions on Applied Perception, 2006
- The perceived roughness of resistive virtual texturesACM Transactions on Applied Perception, 2006
- What role does multisensory integration play in the visuotactile perception of texture?International Journal of Psychophysiology, 2003
- The Effect of Examining Actual Products or Product Descriptions on Consumer PreferenceJournal of Consumer Psychology, 2003
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002
- A further investigation of visual dominancePerception & Psychophysics, 1979
- Visual dominance: An information-processing account of its origins and significance.Psychological Review, 1976