Pin Cao
Pin Cao has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Yongying Yang
Zhejiang University
3 shared publications - Jiabin Jiang
State Key Laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, 38 Zheda Road, Hangzhou 310027, China
2 shared publications - Danhui Zhang
State Key Laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, 38 Zheda Road, Hangzhou 310027, China
1 shared publication - Weimin Lou
State Key Laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, 38 Zheda Road, Hangzhou 310027, China
1 shared publication - Weimin Lou
Zhejiang Key Laboratory of Digital Precision Measurement Technology Research, Zhejiang Institute of Quality Sciences, Hangzhou 310018, China
1 shared publication - Zichen Lu
State Key Laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, 38 Zheda Road, Hangzhou 310027, China
1 shared publication
Latest Publications
- Open Access
- 4 November 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (21) , 10373
Assembly Quality Detection Based on Class-Imbalanced Semi-Supervised Learning
Due to the imperfect assembly process, the unqualified assembly of a missing gasket or lead seal will affect the product’s performance and possibly cause safety accidents. Machine vision method based on deep learning has been widely used in quality inspection. Semi-supervised learning (SSL) has been applied in training deep learning models to reduce the burden of data annotation. The dataset obtained from the production line tends to be class-imbalanced because the assemblies are qualified in most cases. However, most SSL methods suffer from lower performance in class-imbalanced datasets. Therefore, we propose a new semi-supervised algorithm that achieves high classification accuracy on the class-imbalanced assembly dataset with limited labeled data. Based on the mean teacher algorithm, the proposed algorithm uses certainty to select reliable teacher predictions for student learning dynamically, and loss functions are modified to improve the model’s robustness against class imbalance. Results show that when only 10% of the total data are labeled, and the imbalance rate is 5.3, the proposed method can improve the accuracy from 85.34% to 93.67% compared to supervised learning. When the amount of annotated data accounts for 20%, the accuracy can reach 98.83%.
- 4 November 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (21) , 10373
Open AccessAssembly Quality Detection Based on Class-Imbalanced Semi-Supervised Learning
Due to the imperfect assembly process, the unqualified assembly of a missing gasket or lead seal will affect the product’s performance and possibly cause safety accidents. Machine vision method based on deep learning has been widely used in quality inspection. Semi-supervised learning (SSL) has been applied in training deep learning models to reduce the burden of data annotation. The dataset obtained from the production line tends to be class-imbalanced because the assemblies are qualified in most cases. However, most SSL methods suffer from lower performance in class-imbalanced datasets. Therefore, we propose a new semi-supervised algorithm that achieves high classification accuracy on the class-imbalanced assembly dataset with limited labeled data. Based on the mean teacher algorithm, the proposed algorithm uses certainty to select reliable teacher predictions for student learning dynamically, and loss functions are modified to improve the model’s robustness against class imbalance. Results show that when only 10% of the total data are labeled, and the imbalance rate is 5.3, the proposed method can improve the accuracy from 85.34% to 93.67% compared to supervised learning. When the amount of annotated data accounts for 20%, the accuracy can reach 98.83%.
- Open Access
- 18 September 2020
- Published by MDPI AG in Applied Sciences
- Vol. 10 (18) , 6536
Optical Element Surface Defect Size Recognition Based on Decision Regression Tree
Defect size recognition is significant to the evaluation of optical element surface quality. Currently, it’s mainly achieved by the conventional image process, such as threshold segmentation. However, as the defect size gradually approaches the diffraction limit of the imaging system, the defect gray distribution changes from bimodal to unimodal, which makes it difficult to be accurately recognized. In this paper, an electromagnetic simulation model of the microscopic scattering dark-field imaging (MSDI) system is built based on the finite-difference time-domain (FDTD) method to research the defect imaging mechanism. The point spread function (PSF) of our MSDI system is measured to revise the far-field simulation light intensity distribution, and the mean value of the distance between three groups of feature points, whose intensity is 0.75, 0.5, and 0.25 of the light intensity distribution peak value, is taken as the feature parameter of the light intensity distribution. To obtain the defect size, the decision regression tree (DRT) is proposed to get the relationship between the feature parameter and the defect size. Besides, some scratches samples are made to verify the validity of the DRT. The results show the relative error of DRT is within 10%, which is better than the threshold segmentation.
- 18 September 2020
- Published by MDPI AG in Applied Sciences
- Vol. 10 (18) , 6536
Open AccessOptical Element Surface Defect Size Recognition Based on Decision Regression Tree
Defect size recognition is significant to the evaluation of optical element surface quality. Currently, it’s mainly achieved by the conventional image process, such as threshold segmentation. However, as the defect size gradually approaches the diffraction limit of the imaging system, the defect gray distribution changes from bimodal to unimodal, which makes it difficult to be accurately recognized. In this paper, an electromagnetic simulation model of the microscopic scattering dark-field imaging (MSDI) system is built based on the finite-difference time-domain (FDTD) method to research the defect imaging mechanism. The point spread function (PSF) of our MSDI system is measured to revise the far-field simulation light intensity distribution, and the mean value of the distance between three groups of feature points, whose intensity is 0.75, 0.5, and 0.25 of the light intensity distribution peak value, is taken as the feature parameter of the light intensity distribution. To obtain the defect size, the decision regression tree (DRT) is proposed to get the relationship between the feature parameter and the defect size. Besides, some scratches samples are made to verify the validity of the DRT. The results show the relative error of DRT is within 10%, which is better than the threshold segmentation.
- Open Access
- 23 May 2020
- Published by MDPI AG in Applied Sciences
- Vol. 10 (10) , 3621
Surface Defect Detection for Mobile Phone Back Glass Based on Symmetric Convolutional Neural Network Deep Learning
Defect detection based on machine vision and machine learning techniques has drawn much attention in recent years. Deep learning is very suitable for such segmentation and detection tasks and has become a promising research area. Surface quality inspection is essentially important in the manufacturing of mobile phone back glass (MPBG). Different types of defects are produced because of the imperfection of the manufacturing technique. Unlike general transparent glass, screen printing glass has totally different reflection and scattering characteristics, which means the traditional dark-field imaging system is not suitable for this task. Meanwhile, the imaging system requires high resolution since the minimum defect size can be 0.005 mm2. According to the imaging characteristics of screen printing glass, this paper proposes a coaxial bright-field (CBF) imaging system and low-angle bright-field (LABF) imaging system, and 8K line-scan complementary metal oxide semiconductor(CMOS) cameras are utilized to capture images with the resolution size of 16,000*8092. The CBF system is applied for the weak-scratch and discoloration defects while the LABF system is applied for the dent defect. A symmetric convolutional neural network composed of encoder and decoder structures is proposed based on U-net, which produces a semantic segmentation with the same size as the original input image. More than 10,000 original images were captured, and more than 30,000 defective and non-defective images were manually annotated in the glass surface defect dataset (GSDD). Verified by the experiments, the results showed that the average precision reaches more than 91% and the average recall rate reaches more than 95%. The method is very suitable for the surface defect inspection of screen printing mobile phone back glass.
- 23 May 2020
- Published by MDPI AG in Applied Sciences
- Vol. 10 (10) , 3621
Open AccessSurface Defect Detection for Mobile Phone Back Glass Based on Symmetric Convolutional Neural Network Deep Learning
Defect detection based on machine vision and machine learning techniques has drawn much attention in recent years. Deep learning is very suitable for such segmentation and detection tasks and has become a promising research area. Surface quality inspection is essentially important in the manufacturing of mobile phone back glass (MPBG). Different types of defects are produced because of the imperfection of the manufacturing technique. Unlike general transparent glass, screen printing glass has totally different reflection and scattering characteristics, which means the traditional dark-field imaging system is not suitable for this task. Meanwhile, the imaging system requires high resolution since the minimum defect size can be 0.005 mm2. According to the imaging characteristics of screen printing glass, this paper proposes a coaxial bright-field (CBF) imaging system and low-angle bright-field (LABF) imaging system, and 8K line-scan complementary metal oxide semiconductor(CMOS) cameras are utilized to capture images with the resolution size of 16,000*8092. The CBF system is applied for the weak-scratch and discoloration defects while the LABF system is applied for the dent defect. A symmetric convolutional neural network composed of encoder and decoder structures is proposed based on U-net, which produces a semantic segmentation with the same size as the original input image. More than 10,000 original images were captured, and more than 30,000 defective and non-defective images were manually annotated in the glass surface defect dataset (GSDD). Verified by the experiments, the results showed that the average precision reaches more than 91% and the average recall rate reaches more than 95%. The method is very suitable for the surface defect inspection of screen printing mobile phone back glass.