Assembly Monitoring Using Semantic Segmentation Network Based on Multiscale Feature Maps and Trainable Guided Filter
- 15 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 71 (00189456) , 1-11
Abstract
Timely detection of errors in assembly process is important for ensuring assembly quality and efficiency. Image segmentation technology can be used to monitor mechanical assembly for missing assembly, wrong assembly, assembly sequence, and assembly pose. However, unclear segmentation boundaries and low segmentation accuracy of small parts is the main limit of assembly depth image segmentation. Therefore, this study proposes a skip fully convolutional network (FCN) with multiscale feature (MF) maps and a trainable guided filter (TGF) (skip FCN with MF&TGF for short) for depth image segmentation of mechanical assembly. By adding skip connections in the second maximum pooling layer of FCN, additional low-level features can be obtained, which compensates for the problem of insufficient detailed information in feature map prediction. The problem of image segmentation edge blur is mitigated by the integration of a TGF. Moreover, this study establishes a mechanical assembly depth image dataset. The experimental results show that skip FCN with MF&TGF enhances the segmentation precision of mechanical assembly and significantly improves the segmentation edges of depth images. Furthermore, it shows significant improvement in segmentation performance when segmenting small parts. Finally, compared with other semantic segmentation networks, skip FCN with MF&TGF achieves the best segmentation performance on the mechanical assembly depth image dataset.Keywords
Funding Information
- National Natural Science Foundation of China (52175471)
This publication has 34 references indexed in Scilit:
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- Conditional Random Fields as Recurrent Neural Networks2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015
- Image Segmentation Using K -means Clustering Algorithm and Subtractive Clustering AlgorithmProcedia Computer Science, 2015
- Camera as the instrument: the rising trend of vision based measurementIEEE Instrumentation & Measurement Magazine, 2014
- Transfer Learning2010
- Block-based noise estimation using adaptive gaussian filteringIEEE Transactions on Consumer Electronics, 2005
- Statistical region mergingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Watershed of a continuous functionSignal Processing, 1994