Lost in Tracking Translation: A Comprehensive Analysis of Visual SLAM in Human-Centered XR and IoT Ecosystems
Open Access
- 12 December 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Sensor Networks
- Vol. 22 (5) , 1-34
Abstract
Advances in tracking algorithms have enabled applications from steering autonomous vehicles to guiding robots to enhancing augmented reality experiences for users. However, these algorithms are application-specific and do not work across applications with different types of motion; even a tracking algorithm designed for a given application does not work in scenarios deviating from highly standard conditions. For example, a tracking algorithm designed for indoor robot navigation will not work for tracking the same robot in an outdoor environment. To demonstrate this problem, we evaluate the performance of the state-of-the-art tracking methods across various applications and scenarios. To inform our analysis, we first categorize environmental, locomotion-related, and algorithmic challenges faced by tracking algorithms. We quantitatively evaluate the performance using multiple tracking algorithms and representative datasets for a wide range of Internet of Things (IoT) and Extended Reality (XR) applications, including autonomous vehicles, drones, and humans. Our analysis shows that no tracking algorithm works across all applications and even in diverse scenarios within the same application. Ultimately, using the insights generated from our analysis, we discuss multiple approaches to improving the tracking performance using input data characterization, leveraging intermediate information, and output evaluation.Keywords
All Related Versions
Funding Information
- National Science Foundation (2237485, 2435642, and 2525711)
- National Institutes of Health (R61MH135109)
This publication has 118 references indexed in Scilit:
- SLAM; definition and evolutionEngineering Applications of Artificial Intelligence, 2021
- Feature-based visual simultaneous localization and mapping: a surveySN Applied Sciences, 2020
- Simultaneous Localization and Mapping in the Epoch of Semantics: A SurveyInternational Journal of Control, Automation, and Systems, 2018
- ADVIO: An Authentic Dataset for Visual-Inertial Odometry2018
- Ongoing Evolution of Visual SLAM from Geometry to Deep Learning: Challenges and OpportunitiesCognitive Computation, 2018
- Evaluation of the performance of accelerometer-based gait event detection algorithms in different real-world scenarios using the MAREA gait databaseGait & Posture, 2017
- Multiple-Robot Simultaneous Localization and Mapping: A ReviewJournal of Field Robotics, 2015
- Sensor Technologies and Simultaneous Localization and Mapping (SLAM)Procedia Computer Science, 2015
- The Opportunity challenge: A benchmark database for on-body sensor-based activity recognitionPattern Recognition Letters, 2013
- Visual simultaneous localization and mapping: a surveyArtificial Intelligence Review, 2012