Drift-Free BIM Alignment for Mixed Reality Visualization Through Image Style Transfer and Feature Matching
Open Access
Abstract
Accurate localization is a persistent challenge for Mixed Reality (MR) applications in the construction industry, where reliable alignment between digital building models and physical environments is critical. Commercial MR devices such as the Microsoft HoloLens rely on Visual-Inertial Simultaneous Localization and Mapping (VISLAM) for pose estimation, but accumulated drift over extended trajectories and visually ambiguous indoor spaces often reduces localization accuracy. This paper presents a complementary localization refinement methodology that integrates HoloLens spatial tracking with image style transfer and geometry-based pose estimation for Building Information Modeling (BIM)-aligned MR visualization. Image style transfer is used to reduce appearance discrepancies between real-world images and synthetic BIM renderings, improving feature correspondence for geometric alignment. Pose refinement is then applied using feature matching and Perspective-n-Point (PnP) estimation to mitigate accumulated drift when sufficient visual evidence is available. The method is evaluated using 1408 image pairs captured along an indoor trajectory, demonstrating improved BIM alignment, significantly reducing accumulated drift to 1–2 pixels. The proposed approach supports more reliable MR visualization for construction-related tasks such as inspection, coordination, and spatial decision-making.Keywords
Funding Information
- University of Melbourne (644655)
This publication has 55 references indexed in Scilit:
- Interactive Mixed Reality Methods for Visualization of Underground UtilitiesPFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 2024
- On-site Visual Construction Management System Based on the Integration of SLAM-based AR and BIM on a Handheld DeviceKSCE Journal of Civil Engineering, 2023
- Designing Mixed Reality-Based Indoor Navigation for User StudiesKN - Journal of Cartography and Geographic Information, 2022
- A review of augmented reality visualization methods for subsurface utilitiesAdvanced Engineering Informatics, 2022
- Preserving the Knowledge of the Past Through Virtual Visits: From 3D Laser Scanning to Virtual Reality Visualisation at the Istanbul Çatalca İnceğiz CavesPFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 2020
- Integrating BIM and GIS to improve the visual monitoring of construction supply chain managementAutomation in Construction, 2013
- User interface design for military AR applicationsVirtual Reality, 2010
- Identification of application areas for Augmented Reality in industrial construction based on technology suitabilityAutomation in Construction, 2008
- PnP Problem RevisitedJournal of Mathematical Imaging and Vision, 2005
- Visualisation in architecture, engineering and construction (AEC)Automation in Construction, 2005