Unlocking Understanding: An Investigation of Multimodal Communication in Virtual Reality Collaboration
Open Access
- 11 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Abstract
Communication in collaboration, especially synchronous, remote communication, is crucial to the success of task-specific goals. Insufficient or excessive forms of communication may lead to detrimental effects on task performance while increasing mental fatigue. However, identifying which combinations of communication modalities provide the most efficient transfer of information in collaborative settings will greatly improve collaboration. To investigate this, we developed a remote, synchronous, asymmetric VR collaborative assembly task application, where users play the role of either mentor or mentee, and were exposed to different combinations of three communication modalities: voice, gestures, and gaze. Through task-based experiments with 25 pairs of participants (50 individuals), we evaluated quantitative and qualitative data and found that gaze did not differ significantly from multiple combinations of communication modalities. Our qualitative results indicate that mentees experienced more difficulty and frustration in completing tasks than mentors, with both types of users preferring all three modalities to be present.Keywords
This publication has 48 references indexed in Scilit:
- Asynchronous industrial collaboration: How virtual reality and virtual tools aid the process of maintenance method development and documentation creationComputers in Industry, 2022
- AR/MR Remote Collaboration on Physical Tasks: A ReviewRobotics and Computer-Integrated Manufacturing, 2021
- CollaboVR: A Reconfigurable Framework for Creative Collaboration in Virtual Reality2020
- The combination of visual communication cues in mixed reality remote collaborationJournal on Multimodal User Interfaces, 2020
- Sharing gaze rays for visual target identification tasks in collaborative augmented realityJournal on Multimodal User Interfaces, 2020
- A User Study on MR Remote Collaboration Using Live 360 Video2018
- [POSTER] CoVAR: Mixed-Platform Remote Collaborative Augmented and Virtual Realities System with Shared Collaboration Cues2017
- Improving co-presence with augmented visual communication cues for sharing experience through video conference2014
- You look where I look! Effect of gaze cues on overt and covert attention in misdirectionVisual Cognition, 2009
- Ways of the Hands2006