UbiPose: Towards Ubiquitous Outdoor AR Pose Tracking using Aerial Meshes
Open Access
- 2 October 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Abstract
Tracking the position and orientation, or pose, of a viewing device enables AR applications to accurately embed virtual content in physical spaces. Mobile OSs track pose by matching device camera images against street-level imagery. Thus, pose tracking is often unavailable at off-street pedestrian locations. UbiPose enables pose tracking at such locations using aerial meshes, generated from satellite imagery, that are likely to be more widely available at these locations. However, matching a camera image against an aerial mesh can be error-prone, even with modern neural matchers. These neural components are also compute-intensive. UbiPose contains a novel pose tracking pipeline that runs entirely on a mobile device using fast-path optimizations designed to accept or reject pose estimates in many cases, without sacrificing accuracy. Experiments on real-world traces show that it achieves tracking accuracy comparable to AR pose tracking in iOS in places where that is available, and is able to track pose accurately in places where it is not.Keywords
Funding Information
- National Science Foundation (1956445)
This publication has 49 references indexed in Scilit:
- SeeNav2017
- Image-Based Localization Using LSTMs for Structured Feature Correlation2017
- Pose estimation of a mobile robot using monocular vision and inertial sensors data2017
- PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization2015
- Multi-View Stereo: A TutorialFoundations and Trends in Computer Graphics and Vision, 2015
- Visibility Probability Structure from SfM Datasets and Applications2012
- Simultaneous localization and mapping: part IIEEE Robotics & Automation Magazine, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Random sample consensusCommunications of the ACM, 1981