CD-MAE: Contrastive Dual-Masked Autoencoder Pre-Training Model for PCB CT Image Element Segmentation
Open Access
- 7 March 2024
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 13 (6) , 1006
Abstract
Element detection is an important step in the process of the non-destructive testing of printed circuit boards (PCB) based on computed tomography (CT). Compared with the traditional manual detection method, the image semantic segmentation method based on deep learning greatly improves efficiency and accuracy. However, semantic segmentation models often require a large amount of data for supervised training to generalize better model performance. Unlike natural images, the PCB CT image annotation task is more time-consuming and laborious than the semantic segmentation task. In order to reduce the cost of labeling and improve the ability of the model to utilize unlabeled data, unsupervised pre-training is a very reasonable and necessary choice. The masked image reconstruction model represented by a masked autoencoder is pre-trained on the unlabeled data, learning a strong feature representation ability by recovering the masked image, and shows a good generalization ability in various downstream tasks. In the PCB CT image element segmentation task, considering the characteristics of the image, it is necessary to use a model with strong feature robustness in the pre-training stage to realize the representation learning on a large number of unlabeled PCB CT images. Based on the above purposes, we proposed a contrastive dual-masked autoencoder (CD-MAE) pre-training model, which can learn more robust feature representation on unlabeled PCB CT images. Our experiments show that the CD-MAE outperforms the baseline model and fully supervised models in the PCB CT element segmentation task.Keywords
This publication has 24 references indexed in Scilit:
- U2-Net: Going deeper with nested U-structure for salient object detectionPattern Recognition, 2020
- Semantic Segmentation of a Printed Circuit Board for Component Recognition Based on Depth ImagesSensors, 2020
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation2018
- Unified Perceptual Parsing for Scene Understanding2018
- Unsupervised Feature Learning via Non-parametric Instance Discrimination2018
- Wire segmentation for printed circuit board using deep convolutional neural network and graph cut modelIET Image Processing, 2018
- Pyramid Scene Parsing Network2017
- PCB Reverse Engineering Using Nondestructive X-ray Tomography and Advanced Image ProcessingIEEE Transactions on Components, Packaging and Manufacturing Technology, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Fully convolutional networks for semantic segmentation2015