Relative Effects of Real-world and Virtual-World Latency on an Augmented Reality Training Task: An AR Simulation Experiment
Open Access
- 30 January 2017
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in ICT
- Vol. 3
Abstract
In Augmented Reality (AR), virtual objects and information are overlaid onto the user’s view of the physical world and can appear to become part of the real world. Accurate registration of virtual objects is a key requirement for an effective and natural AR system, but misregistration can break the illusion of virtual objects being part of the real world and disrupt immersion. End-to-end system latency severely impacts the quality of AR registration. In this research, we present a controlled study that aims at a deeper understanding of the effects of latency on virtual and real world imagery and its influences on task performance in an AR training task. We utilize an AR Simulation approach, in which an outdoor AR training task is simulated in a high-fidelity VR system. The real and augmented portions of the AR training scenarios are simulated in VR, affording us detailed control over a variety of immersion parameters and the ability to explore the effects of different types of simulated latency. We utilized a representative task inspired by outdoor AR military training systems to compare various AR system configurations, including optical see-through and video see-through setups with both matched and unmatched levels of real and virtual objects latency. Our findings indicate that users are able to perform significantly better when virtual and real-world latencies are matched (as in the case of simulated video-see-through AR with perfect augmentation-to-real-world registration). Unequal levels of latency led to reduction in performance, even when overall latency levels were lower compared to the matched case. The relative results hold up with increased overall latency.Keywords
Funding Information
- Office of Naval Research (417294)
This publication has 23 references indexed in Scilit:
- Quantifying and Mitigating the Negative Effects of Local Latencies on Aiming in 3D Shooter Games2015
- Measuring Latency in Virtual EnvironmentsIEEE Transactions on Visualization and Computer Graphics, 2014
- The Effect of Apparent Latency on Simulator Sickness While Using a See-Through Helmet-Mounted DisplayHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2012
- New Method to Measure End-to-End Delay of Virtual RealityPRESENCE: Virtual and Augmented Reality, 2010
- Virtual Reality: How Much Immersion Is Enough?Computer, 2007
- The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented RealityPRESENCE: Virtual and Augmented Reality, 2006
- Recent advances in augmented realityIEEE Computer Graphics and Applications, 2001
- What's real about virtual reality?IEEE Computer Graphics and Applications, 1999
- A Survey of Augmented RealityPRESENCE: Virtual and Augmented Reality, 1997
- Effects of Visual Display and Motion System Delays on Operator Performance and Uneasiness in a Driving SimulatorHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1988