OpenUVR: an Open-Source System Framework for Untethered Virtual Reality Applications
Authors:
- 1 May 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 223-236
Abstract
Advancements in heterogeneous computing technologies enable the significant potential of virtual reality (VR) applications. To offer the best user experience (UX), a system should adopt an untethered, wireless-network-based architecture to transfer VR content between the user and the content generator. However, modern wireless network technologies make implementing such an architecture challenging, as VR applications require superior video quality-with high resolution, high frame rates, and very low latency. This paper presents OpenUVR, an open-source framework that uses commodity hardware components to satisfy the demands of interactive, real-time VR applications. OpenUVR significantly improves UX through a redesign of the system stack and addresses the most time-sensitive issues associated with redundant memory copying in modern computing systems. OpenUVR presents a cross-layered VR datapath to avoid redundant data operations and computation among system components, OpenUVR customizes the network stack to eliminate unnecessary memory operations incurred by mismatching data formats in each layer, and OpenUVR uses feedback from mobile devices to remove memory buffers. Together, these modifications allow OpenUVR to reduce VR application delays to 14.32 ms, meeting the 20 ms minimum latency in avoiding motion sickness. As an open-source system that is fully compatible with commodity hardware, OpenUVR offers the research community an opportunity to develop, investigate, and optimize applications for untethered, high-performance VR architectures.Keywords
All Related Versions
Funding Information
- National Science Foundation
- North Carolina State University
- University of California
This publication has 53 references indexed in Scilit:
- PIM-VR: Erasing Motion Anomalies In Highly-Interactive Virtual Reality World with Customized Memory Cube2019
- Rendering Elimination: Early Discard of Redundant Tiles in the Graphics Pipeline2019
- Communication-Constrained Mobile Edge Computing Systems for Wireless Virtual Reality: Scheduling and TradeoffIEEE Access, 2018
- Perception-Oriented 3D Rendering Approximation for Modern Graphics Processors2018
- Shooting a moving target: Motion-prediction-based transmission for 360-degree videos2016
- Measuring Latency in Virtual Reality Systems2015
- Perception-aware power management for mobile games via dynamic resolution scaling2015
- Eliminating redundant fragment shader executions on a mobile GPU via hardware memoization2014
- Parallel video decoding in the emerging HEVC standard2012
- Efficient Parallelization of H.264 Decoding with Macro Block Level Scheduling2007