D3PointNet: Dual-Level Defect Detection PointNet for Solder Paste Printer in Surface Mount Technology
Open Access
- 31 July 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 140310-140322
Abstract
In the field of surface mount technology (SMT), early detection of defects in production machines is crucial to prevent yield reduction. In order to detect defects in the production machine without attaching additional costly sensors, attempts have been made to classify defects in solder paste printers using defective solder paste pattern (DSPP) images automatically obtained through solder paste inspection (SPI). However, since the DSPP images are sparse, have various sizes, and are hardly collected, existing CNNbased classifiers tend to fail to generalize and over-fitted to the train set. Besides, existing studies employing only multi-label classifiers are less helpful since when two or more defects are observed in the DSPP image, the location of each defect can not be specified. To solve these problems, we propose a dual-level defect detection PointNet (D3PointNet), which extracts point cloud features from DSPP images and then performs the defect detection in two semantic levels: a micro-level and a macro-level. In the micro-level, a type of printer defect per point is identified through segmentation. In the macro-level, all types of printer defects appearing in a DSPP image are identified by multi-label classification. Experimental results show that the proposed D3PointNet is robust to the sparsity and size changes of the DSPP image, and its exact match score was 10.2% higher than that of the existing CNN-based state-of-the-art multi-label classification model in the DSPP image dataset.Keywords
Funding Information
- Industrial Strategic Technology Development Program (Machine Learning-Based SMT Process Optimization System Development) funded by the Ministry of Trade, Industry and Energy (MOTIE), South Korea (10077589)
- Institute for Information and Communications Technology Promotion (IITP) funded by the Ministry of Science and ICT (MSIT), Korea Government (2016-0-00563)
This publication has 25 references indexed in Scilit:
- A Machine Vision Based Automatic Optical Inspection System for Measuring Drilling Quality of Printed Circuit BoardsIEEE Access, 2016
- CNN-RNN: A Unified Framework for Multi-label Image Classification2016
- Multi-view Convolutional Neural Networks for 3D Shape Recognition2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Stereo Vision Based Automated Solder Ball Height and Substrate Coplanarity InspectionIEEE Transactions on Automation Science and Engineering, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- A Bayesian Approach to Automated Optical Inspection for Solder Jet Ball Joint Defects in the Head Gimbal Assembly ProcessIEEE Transactions on Automation Science and Engineering, 2014
- Solder Paste Scooping Detection by Multilevel Visual Inspection of Printed Circuit BoardsIEEE Transactions on Industrial Electronics, 2012
- Solder paste inspection using region-based defect detectionThe International Journal of Advanced Manufacturing Technology, 2008
- Application of Neural Networks in Optical Inspection and Classification of Solder Joints in Surface Mount TechnologyIEEE Transactions on Industrial Informatics, 2006