Computer Vision and Augmented Reality for Human-Centered Fatigue Crack Inspection
Open Access
Abstract
A significant percentage of bridges in the United States are serving beyond their 50-year design life, and many of them are in poor condition, making them vulnerable to fatigue cracks that can result in catastrophic failure. However, current fatigue crack inspection practice based on human vision is time-consuming, labor intensive, and prone to error. We present a novel human-centered bridge inspection methodology to enhance the efficiency and accuracy of fatigue crack detection by employing advanced technologies including computer vision and augmented reality (AR). In particular, a computer vision-based algorithm is developed to enable near-real-time fatigue crack detection by analyzing structural surface motion in a short video recorded by a moving camera of the AR headset. The approach monitors structural surfaces by tracking feature points and measuring variations in distances between feature point pairs to recognize the motion pattern associated with the crack opening and closing. Measuring distance changes between feature points, as opposed to their displacement changes before this improvement, eliminates the need of camera motion compensation and enables reliable and computationally efficient fatigue crack detection using the nonstationary AR headset. In addition, an AR environment is created and integrated with the computer vision algorithm. The crack detection results are transmitted to the AR headset worn by the bridge inspector, where they are converted into holograms and anchored on the bridge surface in the 3D real-world environment. The AR environment also provides virtual menus to support human-in-the-loop decision-making to determine optimal crack detection parameters. This human-centered approach with improved visualization and human–machine collaboration aids the inspector in making well-informed decisions in the field in a near-real-time fashion. The proposed crack detection method is comprehensively assessed using two laboratory test setups for both in-plane and out-of-plane fatigue cracks. Finally, using the integrated AR environment, a human-centered bridge inspection is conducted to demonstrate the efficacy and potential of the proposed methodology.Keywords
Funding Information
- NCHRP (IDEA 223)
This publication has 24 references indexed in Scilit:
- Coupled propagation behavior of multiple fatigue cracks in welded joints of steel-bridgeJournal of Constructional Steel Research, 2024
- Augmented reality-computer vision combination for automatic fatigue crack detection and localizationComputers in Industry, 2023
- Vision-based fatigue crack detection using global motion compensation and video feature trackingEarthquake Engineering and Engineering Vibration, 2023
- Development of a Distortion-Induced Fatigue Crack Characterization Methodology Using Digital Image CorrelationJournal of Bridge Engineering, 2020
- Benchmark for Evaluating Performance in Visual Inspection of Fatigue Cracking in Steel BridgesJournal of Bridge Engineering, 2020
- A vision-based method for crack detection in gusset plate welded joints of steel bridges using deep convolutional neural networksAutomation in Construction, 2019
- Image‐Based Crack Detection for Real Concrete SurfacesIEEJ Transactions on Electrical and Electronic Engineering, 2007
- Evaluation of Augmented Reality for Rapid Assessment of Earthquake-Induced Building DamageJournal of Computing in Civil Engineering, 2007
- Analysis of Edge-Detection Techniques for Crack Identification in BridgesJournal of Computing in Civil Engineering, 2003
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992