Integrating BIM and UAV-based photogrammetry for Automated 3D Structure Model Segmentation
Authors:
- Siqi ChenSCSiqi Chen
- Shanyue GuanSGShanyue Guan
Preprint
Abstract
The advancement of UAV technology has enabled efficient, non-contact structural health monitoring. Combined with photogrammetry, UAVs can capture high-resolution scans and reconstruct detailed 3D models of infrastructure. However, a key challenge remains in segmenting specific structural components from these models-a process traditionally reliant on time-consuming and error-prone manual labeling. To address this issue, we propose a machine learning-based framework for automated segmentation of 3D point clouds. Our approach uses the complementary strengths of real-world UAV-scanned point clouds and synthetic data generated from Building Information Modeling (BIM) to overcome the limitations associated with manual labeling. Validation on a railroad track dataset demonstrated high accuracy in identifying and segmenting major components such as rails and crossties. Moreover, by using smaller-scale datasets supplemented with BIM data, the framework significantly reduced training time while maintaining reasonable segmentation accuracy. This automated approach improves the precision and efficiency of 3D infrastructure model segmentation and advances the integration of UAV and BIM technologies in structural health monitoring and infrastructure management.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Deep learning-based pipe segmentation and geometric reconstruction from poorly scanned point clouds using BIM-driven data alignmentAutomation in Construction, 2025
- UAV-based studies in railway infrastructure monitoringAutomation in Construction, 2024
- Automated BIM-to-scan point cloud semantic segmentation using a domain adaptation network with hybrid attention and whitening (DawNet)Automation in Construction, 2024
- Enhancing point cloud semantic segmentation in the data‐scarce domain of industrial plants through synthetic dataComputer-Aided Civil and Infrastructure Engineering, 2024
- Point Cloud Analysis of Railway Infrastructure: A Systematic Literature ReviewIEEE Access, 2023
- East Palestine, Ohio, Railroad Derailment—Lessons to Learn, Actions to TakeAmerican Journal of Public Health, 2023
- Point cloud semantic segmentation of complex railway environments using deep learningAutomation in Construction, 2022
- BIM-driven data augmentation method for semantic segmentation in superpoint-based deep learning networkAutomation in Construction, 2022
- Inspection of exterior substance on high-speed train bottom based on improved deep learning methodMeasurement, 2020