Bolt Loosening Detection Using Key-Point Detection Enhanced by Synthetic Datasets
Open Access
- 3 February 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (3) , 2020
Abstract
Machine vision based on deep learning is gaining more and more applications in structural health monitoring (SHM) due to the rich information that can be achieved in the images. Bolts are widely used in the connection of steel structures, and their loosening can compromise the safety of steel structures and lead to serious accidents. Therefore, this paper proposes a method for the automatic detection of the bolt loosening angle based on the latest key point detection technology using machine vision and deep learning. First, we built a virtual laboratory in Unreal Engine5 that could automatically label and generate synthetic datasets, and the datasets with bolts were collected. Second, the datasets were trained using the YOLOv7-pose framework, and the resulting model was able to accurately detect key points of bolts in images obtained under different angles and lighting conditions. Third, a bolt loosening angle calculation method was proposed according to the detected key points and the position relationship between neighboring bolts. Our results demonstrate that the proposed method is effective at detecting the bolt loosening angle and that the use of synthetic datasets significantly improves the efficiency of datasets establishment while also improving the performance of model training.Keywords
This publication has 40 references indexed in Scilit:
- A Review Paper on Looseness Detection Methods in Bolted StructuresLatin American Journal of Solids and Structures, 2017
- Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields2017
- Vision-based detection of loosened bolts using the Hough transform and support vector machinesAutomation in Construction, 2016
- SSD: Single Shot MultiBox Detector2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Bolt-loosening identification of bolt connections by vision image-based technique2016
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Combination of Longitudinal and Transverse Ultrasonic Waves for In Situ Control of the Tightening of BoltsJournal of Pressure Vessel Technology, 2006
- Handbook of Bolts and Bolted Joints1998