A Novel Real-Time Match-Moving Method with HoloLens
Open Access
- 19 July 2019
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 9 (14) , 2889
Abstract
With the advancement of media and computing technologies, video compositing techniques have improved to a great extent. These techniques have been used not only in the entertainment industry but also in advertisement and new media. Match-moving is a cinematic technology in virtual-real image synthesis that allows the insertion of computer graphics (virtual objects) into real world scenes. To make a realistic virtual-real image synthesis, it is important to obtain internal parameters (such as focal length) and external parameters (position and rotation) from an Red-Green-Blue(RGB) camera. Conventional methods recover these parameters by extracting feature points from recorded video frames to guide the virtual camera. These methods fail when there is occlusion or motion blur in the recorded scene. In this paper, we propose a novel method (system) for pre-visualization and virtual-real image synthesis that overcomes the limitations of conventional methods. This system uses the spatial understanding principle of Microsoft HoloLens to perform the match-moving of virtual-real video scenes. Experimental results demonstrate that our system is much more accurate and efficient than existing systems for video compositing.Keywords
This publication has 20 references indexed in Scilit:
- The accuracy of the Oculus Rift virtual reality head-mounted display during cervical spine mobility measurementJournal of Biomechanics, 2015
- Head tracking for the Oculus Rift2014
- A Study on Correcting Virtual Camera Tracking Data for Digital CompositingJournal of the Korea Society of Computer and Information, 2012
- Using Camera Tracking and Image Composition Technique in Visual Effect Imaginary ProductionJOURNAL OF THE KOREA CONTENTS ASSOCIATION, 2011
- Semantic structure from motion2011
- Parallel Tracking and Mapping for Small AR Workspaces2007
- Extrinsic Camera Parameter Estimation Based-on Feature Tracking and GPS DataLecture Notes in Computer Science, 2006
- Visual Modeling with a Hand-Held CameraInternational Journal of Computer Vision, 2004
- Real-time simultaneous localisation and mapping with a single camera2003
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000