ConeSpeech: Exploring Directional Speech Interaction for Multi-Person Remote Communication in Virtual Reality
- 22 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 29 (5) , 2647-2657
Abstract
Remote communication is essential for efficient collaboration among people at different locations. We present ConeSpeech, a virtual reality (VR) based multi-user remote communication technique, which enables users to selectively speak to target listeners without distracting bystanders. With ConeSpeech, the user looks at the target listener and only in a cone-shaped area in the direction can the listeners hear the speech. This manner alleviates the disturbance to and avoids overhearing from surrounding irrelevant people. Three featured functions are supported, directional speech delivery, size-adjustable delivery range, and multiple delivery areas, to facilitate speaking to more than one listener and to listeners spatially mixed up with bystanders. We conducted a user study to determine the modality to control the cone-shaped delivery area. Then we implemented the technique and evaluated its performance in three typical multi-user communication tasks by comparing it to two baseline methods. Results show that ConeSpeech balanced the convenience and flexibility of voice communication.Keywords
Funding Information
- Youth Science Fund Project (62132010, 62102221, 62002198)
- Beijing Key Lab of Networked Multimedia
- Institute for Artificial Intelligence
- Tsinghua University
This publication has 45 references indexed in Scilit:
- Aura Garden2018
- Single or Multiple Conversational Agents?2018
- Mini-Me2018
- Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay2017
- Design and Evaluation of a Handheld-based 3D User Interface for Collaborative Object Manipulation2017
- Holoportation2016
- Point & Teleport Locomotion Technique for Virtual Reality2016
- Elevating Communication, Collaboration, and Shared Experiences in Mobile Video through Drones2016
- Consumed endurance2014
- Silent speech interfacesSpeech Communication, 2010