Apple v.s. Meta: A Comparative Study on Spatial Tracking in SOTA XR Headsets
Open Access
- 4 December 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2120-2127
Abstract
Inaccurate spatial tracking in extended reality (XR) headsets can cause virtual object jitter, misalignment, and user discomfort, limiting the headsets' potential for immersive content and natural interactions. We develop a modular testbed to evaluate the tracking performance of commercial XR headsets, incorporating system calibration, tracking data acquisition, and result analysis, and allowing the integration of external cameras and IMU sensors for comparison with open-source VI-SLAM algorithms. Using this testbed, we quantitatively assessed spatial tracking accuracy under various user movements and environmental conditions for the latest XR headsets, Apple Vision Pro and Meta Quest 3. The Apple Vision Pro outperformed the Meta Quest 3, reducing relative pose error (RPE) and absolute pose error (APE) by 33.9% and 14.6%, respectively. While both headsets achieved subcentimeter APE in most cases, they exhibited APE exceeding 10 cm in challenging scenarios, highlighting the need for further improvements in reliability and accuracy.Keywords
Funding Information
- NSF (National Science Foundation) (CSR-2312760, CNS-2112562, IIS-2231975, IIS-2046072, 2332744)
- Cisco Systems
- Meta
This publication has 15 references indexed in Scilit:
- Validity and reliability of the tracking measures extracted from the oculus quest 2 during locomotionComputer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2023
- Here To Stay: A Quantitative Comparison of Virtual Object Stability in Markerless Mobile AR2022
- Evaluation of the Oculus Rift S tracking system in room scale virtual realityVirtual Reality, 2022
- MBA-VO: Motion Blur Aware Visual Odometry2021
- Can You Trust Your Pose? Confidence Estimation in Visual Localization2021
- Quantitative analysis of the Oculus Rift S in controlled movementDisability and Rehabilitation: Assistive Technology, 2019
- Survey and evaluation of monocular visual-inertial SLAM algorithms for augmented realityVirtual Reality & Intelligent Hardware, 2019
- Structure-from-Motion Revisited2016
- Introducing SLAMBench, a performance and accuracy benchmarking methodology for SLAM2015
- Least-squares estimation of transformation parameters between two point patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991