VanityX: An Agile 3D Rendering Platform Supporting Mixed Reality
Open Access
- 27 April 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (9) , 5468
Abstract
VanityX is a prototype, low-level, real-time 3D rendering and computing platform. Unlike most XR solutions, which integrate several commercial and/or open-source products, such as game engines, XR libraries, runtime, and services, VanityX is a platform ready to adapt to any business domain including anthropology and medicine. The design, architecture, and implementation are presented, which are based on CPU and GPU asymmetric multiprocessing with explicit synchronization and collaboration of parallel tasks and a predictable transfer of pipeline resources between processors. The VanityX API is based on DirectX 12 and native programming languages C++20 and HLSL 6, which, in conjunction with explicit parallel processing, the asynchronous loading and explicit managing of graphic resources, and effective algorithms, results in great performance and resource utilization close to metal. Surface-based rendering, direct volume rendering (DVR), and mixed reality (MR) on the HoloLens 2 immersive headset are currently supported. Our MR applications are directly compiled and deployed to HoloLens 2 allowing for better programming experiences and software engineering practices such as testing, debugging, and profiling. The VanityX server provides various computational and rendering services to its clients running on HoloLens 2. The use and test cases are in many business domains including anthropology and medicine. Our future research challenges will primarily, via the MetaverseMed project, focus on opening new opportunities for implementing innovative MR-based scenarios in medical procedures, especially in education, diagnostics, and surgical operations.Keywords
This publication has 18 references indexed in Scilit:
- Real-Time Rendering2018
- Game Engine Architecture, Third Edition2018
- Image Reconstruction is a New Frontier of Machine LearningIEEE Transactions on Medical Imaging, 2018
- Applying Multi-User Virtual Reality to Collaborative Medical Training2018
- Dense Semantic 3D ReconstructionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Image segmentation based on complexity mining and mean-shift algorithm2014
- Isosurfaces2013
- SCIPVM: Parallel distributed computing on SCI workstation clustersConcurrency: Practice and Experience, 1999
- The PVM concurrent computing system: Evolution, experiences, and trendsParallel Computing, 1994
- Marching cubes: A high resolution 3D surface construction algorithmACM SIGGRAPH Computer Graphics, 1987