Multimodality in VR: A Survey
Authors:
Top Cited Papers
Open Access
- 31 January 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 54 (10s) , 1-36
Abstract
Virtual reality (VR) is rapidly growing, with the potential to change the way we create and consume content. In VR, users integrate multimodal sensory information they receive to create a unified perception of the virtual world. In this survey, we review the body of work addressing multimodality in VR and its role and benefits in user experience, together with different applications that leverage multimodality in many disciplines. These works thus encompass several fields of research and demonstrate that multimodality plays a fundamental role in VR, enhancing the experience, improving overall performance, and yielding unprecedented abilities in skill and knowledge transfer.Keywords
All Related Versions
Funding Information
- European Research Council (682080)
- European Union’s Horizon 2020 (765121, and 956585)
- Gobierno de Aragón (2020-2024, and 2018-2022)
This publication has 173 references indexed in Scilit:
- Modulation of Visually Evoked Postural Responses by Contextual Visual, Haptic and Auditory Information: A ‘Virtual Reality Check’PLOS ONE, 2013
- The building blocks of the full body ownership illusionFrontiers in Human Neuroscience, 2013
- Taste and odor recognition memory: the emotional flavor of lifeReviews in the Neurosciences, 2012
- Cortical Shape Adaptation Transforms a Circle Into a HexagonPsychological Science, 2011
- Virtual reality in neuroscience research and therapyNature Reviews Neuroscience, 2011
- Multisensory Stimulation Can Induce an Illusion of Larger Belly Size in Immersive Virtual RealityPLOS ONE, 2011
- Place illusion and plausibility can lead to realistic behaviour in immersive virtual environmentsPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- If I Were You: Perceptual Illusion of Body SwappingPLOS ONE, 2008
- Ventriloquism aftereffects occur in the rear hemisphereNeuroscience Letters, 2006
- Synaesthesia in phantom limbs induced with mirrorsProceedings Of The Royal Society B-Biological Sciences, 1996