Incorporating Drone Into Mixed Reality for Enhanced Remote Collaboration: A User Study on Inspection Task
- 15 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (3) , 2741-2757
Abstract
We present a novel Mixed Reality (MR) remote collaboration system that integrates a telepresence drone to overcome viewpoint limitations in previous approaches. Current remote collaboration systems often restrict remote users to the local user’s perspective or a fixed viewpoint, which may reduce spatial awareness and collaboration effectiveness. Our proposed system enables a remote user wearing a VR headset to independently navigate the local environment through a drone while guiding a local AR headset user. The drone represents the remote user physically and virtually with an AR avatar. The system provides the remote user with a 3D reconstruction of the local environment, the local user’s avatar, and real-time drone camera video to facilitate drone operation and collaboration. A user study comparing our drone-enhanced MR system with 2D video and 360-degree video MR systems during inspection tasks revealed that the telepresence drone significantly improved collaboration efficiency and enhanced users’ social presence and spatial presence. However, the remote users perceived a higher workload. Our findings demonstrate the benefits of independent spatial navigation through drones in remote collaboration and offer insights for future drone-enhanced MR remote collaboration systems.Keywords
This publication has 56 references indexed in Scilit:
- Co-existing with Drones: A Virtual Exploration of Proxemic Behaviours and Users’ Insights on Social DronesInternational Journal of Social Robotics, 2024
- AR/MR Remote Collaboration on Physical Tasks: A ReviewRobotics and Computer-Integrated Manufacturing, 2021
- Exploring contributions of drones towards Industry 4.0Industrial Robot: the international journal of robotics research and application, 2021
- Exploring interaction techniques for 360 panoramas inside a 3D reconstructed scene for mixed reality remote collaborationJournal on Multimodal User Interfaces, 2020
- Using a Head Pointer or Eye Gaze: The Effect of Gaze on Spatial AR Remote Collaboration for Physical TasksInteracting with Computers, 2020
- Collocated Human-Drone Interaction: Methodology and Approach Strategy2019
- 2.5DHANDS: a gesture-based MR remote collaborative platformThe International Journal of Advanced Manufacturing Technology, 2019
- User experience and interaction performance in 2D/3D telecollaborationFuture Generation Computer Systems, 2018
- Vishnu: virtual immersive support for HelpiNg users an interaction paradigm for collaborative remote guiding in mixed reality2016
- HandsOnVideo: Towards a Gesture based Mobile AR System for Remote Collaboration2011