XR Reality Check: What Commercial Devices Deliver for Spatial Tracking
Authors:
- 8 October 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 932-942
Abstract
Inaccurate spatial tracking in extended reality (XR) devices leads to virtual object jitter, misalignment, and user discomfort, fundamentally limiting immersive experiences and natural interactions. In this work, we introduce a novel testbed that enables simultaneous, synchronized evaluation of multiple XR devices under identical environmental and kinematic conditions. Leveraging this platform, we present the first comprehensive empirical benchmarking of five state-of-the-art XR devices across 16 diverse scenarios. Our results reveal substantial intra-device performance variation, with individual devices exhibiting up to 101% increases in error when operating in featureless environments. We also demonstrate that tracking accuracy strongly correlates with visual conditions and motion dynamics. We also observe significant inter-device disparities, with performance differences of up to $2.8 \times$, which are closely linked to hardware specifications such as sensor configurations and dedicated processing units. Finally, we explore the feasibility of substituting a motion capture system with the Apple Vision Pro as a practical ground truth reference. While the Apple Vision Pro delivers highly accurate relative pose error estimates ($R^{2}=0.830$), its absolute pose error estimation remains limited ($R^{2}=0.387$), highlighting both its potential and its constraints for rigorous XR evaluation. This work establishes the first standardized framework for comparative XR tracking evaluation, providing the research community with reproducible methodologies, comprehensive benchmark datasets, and open-source tools that enable systematic analysis of tracking performance across devices and conditions, thereby accelerating the development of more robust spatial sensing technologies for XR systems.
Keywords
All Related Versions
Funding Information
- NSF (CSR-2312760,CNS-2112562,IIS-2231975)
- Army Research Laboratory (W911NF-23-2-0224)
This publication has 35 references indexed in Scilit:
- Review on SLAM algorithms for Augmented RealityDisplays, 2024
- Validity and reliability of the tracking measures extracted from the oculus quest 2 during locomotionComputer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2023
- Here To Stay: A Quantitative Comparison of Virtual Object Stability in Markerless Mobile AR2022
- Evaluation of the Oculus Rift S tracking system in room scale virtual realityVirtual Reality, 2022
- MBA-VO: Motion Blur Aware Visual Odometry2021
- Quantitative analysis of the Oculus Rift S in controlled movementDisability and Rehabilitation: Assistive Technology, 2019
- Survey and evaluation of monocular visual-inertial SLAM algorithms for augmented realityVirtual Reality & Intelligent Hardware, 2019
- Structure-from-Motion Revisited2016
- How wrong can you be: Perception of static orientation errors in mixed reality2014
- Analysis of texture characteristics associated with visual complexity perceptionOptical Review, 2012