A Framework for Synchronous Extraction of Multitype Steel Mesh Features Based on Measured Point Clouds
- 21 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-12
Abstract
In large infrastructure projects, the precision and quality of welding large-scale steel mesh sheets are crucial for the safety of the building structure. Traditional manual welding is inefficient and risky, thus, there is an urgent need to replace manual labor with specialized robots equipped with visual recognition systems. However, identifying features like weld points on diverse steel components remains a bottleneck for the application of robotic welding technology. This paper proposes a framework for simultaneous extraction of multi-type steel mesh features based on measured point clouds to meet the requirements of a visual-guided robotic welding system. Initially, Euclidean clustering method is employed to segment the point cloud and obtain all point cloud clusters that belong to the rebar body. Subsequently, Principal Component Analysis (PCA) and geometric constraints are utilized to merge the point cloud clusters belonging to the same rebar or overlapping rebar. Finally, feature extraction of rebar’s intersection welding points and lap weld seams is performed using methods such as Statistical Outlier Removal (SOR) and Least Squares Cylinder Fitting. Additional ablation experiments were conducted to assess the robustness of the framework. To substantiate the feasibility of the framework, the recommended approach was compared with existing point cloud-based and image-based methods. The results indicate that the framework achieves a balance between efficiency and stable robustness while ensuring recognition accuracy.Keywords
Funding Information
- National Natural Science Foundation of China (U2013202, 62203072, 61922053, 62033001)
- Fundamental Research Funds for the Central Universities (2023CDJXY-014)
- Program of Shanghai Academic Research Leader (21XD1421400)
- China Postdoctoral Science Foundation (2022M710516)
This publication has 32 references indexed in Scilit:
- Research on 3D curved weld seam trajectory position and orientation detection methodOptics and Lasers in Engineering, 2022
- A method of welding path planning of steel mesh based on point cloud for welding robotThe International Journal of Advanced Manufacturing Technology, 2021
- Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registrationMultimedia Tools and Applications, 2020
- Autonomous seam recognition and feature extraction for multi-pass welding based on laser stripe edge guidance networkThe International Journal of Advanced Manufacturing Technology, 2020
- Point cloud 3D parent surface reconstruction and weld seam feature extraction for robotic grinding path planningThe International Journal of Advanced Manufacturing Technology, 2020
- A robust weld seam recognition method under heavy noise based on structured-light visionRobotics and Computer-Integrated Manufacturing, 2020
- Weld image deep learning-based on-line defects detection using convolutional neural networks for Al alloy in robotic arc weldingJournal of Manufacturing Processes, 2019
- Laser vision seam tracking system based on image processing and continuous convolution operator trackerOptics and Lasers in Engineering, 2018
- Machine vision based path planning for a robotic golf club head welding systemRobotics and Computer-Integrated Manufacturing, 2011
- Recognition of the initial position of weld based on the image pattern match technology for welding robotThe International Journal of Advanced Manufacturing Technology, 2005