Bridge Geometric Shape Measurement Using LiDAR–Camera Fusion Mapping and Learning-Based Segmentation Method
Open Access
Abstract
The rapid measurement of three-dimensional bridge geometric shapes is crucial for assessing construction quality and in-service structural conditions. Existing geometric shape measurement methods predominantly rely on traditional surveying instruments, which suffer from low efficiency and are limited to sparse point sampling. This study proposes a novel framework that utilizes an airborne LiDAR–camera fusion system for data acquisition, reconstructs high-precision 3D bridge models through real-time mapping, and automatically extracts structural geometric shapes using deep learning. The main contributions include the following: (1) A synchronized LiDAR–camera fusion system integrated with an unmanned aerial vehicle (UAV) and a microprocessor was developed, enabling the flexible and large-scale acquisition of bridge images and point clouds; (2) A multi-sensor fusion mapping method coupling visual-inertial odometry (VIO) and Li-DAR-inertial odometry (LIO) was implemented to construct 3D bridge point clouds in real time robustly; and (3) An instance segmentation network-based approach was proposed to detect key structural components in images, with detected geometric shapes projected from image coordinates to 3D space using LiDAR–camera calibration parameters, addressing challenges in automated large-scale point cloud analysis. The proposed method was validated through geometric shape measurements on a concrete arch bridge. The results demonstrate that compared to the oblique photogrammetry method, the proposed approach reduces errors by 77.13%, while its detection time accounts for 4.18% of that required by a stationary laser scanner and 0.29% of that needed for oblique photogrammetry.Keywords
Funding Information
- the Key Laboratory of Target Cognition and Application Technology (2023-CXPT-LC-005, STDTKF202303, 202410304059Z)
- the Key Laboratory of Road and Railway Engineering Safety and Security (2023-CXPT-LC-005, STDTKF202303, 202410304059Z)
- the Innovative training program for university students (2023-CXPT-LC-005, STDTKF202303, 202410304059Z)
This publication has 39 references indexed in Scilit:
- Automated recognition and rebar dimensional assessment of prefabricated bridge components from low-cost 3D laser scannerMeasurement, 2024
- Integration of TLS-derived Bridge Information Modeling (BrIM) with a Decision Support System (DSS) for digital twinning and asset management of bridge infrastructuresComputers in Industry, 2023
- Automated bridge component recognition using close-range images from unmanned aerial vehiclesEngineering Structures, 2022
- Automated semantic segmentation of bridge components from large-scale point clouds using a weighted superpoint graphAutomation in Construction, 2022
- Segmentation of large-scale masonry arch bridge point clouds with a synthetic simulator and the BridgeNet neural networkAutomation in Construction, 2022
- UAV-based bridge geometric shape measurement using automatic bridge component detection and distributed multi-view reconstructionAutomation in Construction, 2022
- Automated semantic segmentation of bridge point cloud based on local descriptor and machine learningAutomation in Construction, 2022
- High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo visionInformation Fusion, 2022
- Automated markerless registration of point clouds from TLS and structured light scanner for heritage documentationJournal of Cultural Heritage, 2019
- High-speed 3D shape measurement with structured light methods: A reviewOptics and Lasers in Engineering, 2018