A Seam Tracking Method Based on an Image Segmentation Deep Convolutional Neural Network
Open Access
Abstract
Vision-based welding seam tracking is an important and unique branch of welding automation. Active vision seam tracking systems achieve accurate feature extraction by using an auxiliary light source, but this will introduce extra costs and the real-time performance will be affected. In contrast, passive vision systems achieve better real-time performance and their structure is relatively simple. This paper proposes a passive vision welding seam tracking system in Plasma Arc Welding (PAW) based on semantic segmentation. The BiseNetV2 network is adopted in this paper and online hard example mining (OHEM) is used to improve the segmentation effect. This network structure is a lightweight structure allowing effective image feature extraction. According to the segmentation results, the offset between the welding seam and the welding torch can be calculated. The results of the experiments show that the proposed method can achieve 57 FPS and the average error of the offset calculation is within 0.07 mm, meaning it can be used for real-time seam tracking.Keywords
Funding Information
- National Natural Science Foundation of China (61727802, 61901220, 62101265)
- China Postdoctoral Science Foundation (2021M691592)
- Fundamental Research Funds for the Central Universities (30922010705)
This publication has 17 references indexed in Scilit:
- A robust weld seam detection method based on particle filter for laser welding by using a passive vision sensorThe International Journal of Advanced Manufacturing Technology, 2019
- Learning a Discriminative Feature Network for Semantic Segmentation2018
- Laser vision seam tracking system based on image processing and continuous convolution operator trackerOptics and Lasers in Engineering, 2018
- Quality assessment in laser welding: a critical reviewThe International Journal of Advanced Manufacturing Technology, 2017
- A robust butt welding seam finding technique for intelligent robotic welding system using active laser visionThe International Journal of Advanced Manufacturing Technology, 2016
- Training Region-Based Object Detectors with Online Hard Example Mining2016
- Real-time image processing for vision-based weld seam tracking in robotic GMAWThe International Journal of Advanced Manufacturing Technology, 2014
- Weld line detection and process control for welding automationMeasurement Science and Technology, 2007
- A vision-based algorithm for seam detection in a PAW process for large-diameter stainless steel pipesThe International Journal of Advanced Manufacturing Technology, 2004
- Tracking control system using image sensor for arc weldingAutomatica, 1983