A Novel Three-Probability Spaces Logic Decoupling Distillation for Flip-Chip Defect Detection
- 23 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-10
Abstract
Although deep learning has achieved remarkable results in the industry, to achieve the ultimate prediction accuracy improvement, many existing models with poor performance will be added with other modules, which will become more and more bloated. To achieve the deployment of the lightweight network in an industrial system, knowledge distillation (KD) is currently an effective way to reduce model size. This study focused on the research of knowledge transfer logic and decoupled the interactive information into 3-probability spaces, namely the target space (t), the intraclass class space (o\t), and the out-of-class class space (c\o). The 3-probability spaces method is named TOCKD (t-o\t-c\o spaces knowledge distillation), which introduces three components corresponding to 3-probability spaces, that is target knowledge distillation (TKD), intraclass knowledge distillation (OKD), and out-of-class knowledge distillation (CKD). Based on the support of the flip-chip vibration signal with defect information obtained by ultrasonic excitation experiment, the research confirms the primacy of TKD in the information transmission process and the auxiliary properties of the other two components by qualitative analysis. To realize the quantitative analysis of the corresponding coefficients of three components in TOCKD, Tree-structured Parzen Estimator (TPE) is used to search the coefficients. On the basis of it, combined with subjective and objective weight analysis methods, the guide value of coefficients is defined. This research verifies the excellent performance and robustness of TOCKD by analyzing the flip-chip vibration signals, and hopes that TOCKD will be helpful for future research and the application of lightweight technology in the engineering field.Keywords
This publication has 25 references indexed in Scilit:
- Knowledge distilling based model compression and feature learning in fault diagnosisApplied Soft Computing, 2020
- Quality suitability modeling of volatile oil in Chinese Materia Medica – Based on maximum entropy and independent weight coefficient method: Case studies of Atractylodes lancea, Angelica sinensis, Curcuma longa and Atractylodes macrocephalaIndustrial Crops and Products, 2019
- Evaluating the International Competitiveness of Vietnam Wood Processing Industry by Combining the Variation Coefficient and the Entropy MethodForests, 2019
- Simulation and Experimental Investigation on Active Thermography Test of the Solder BallsIEEE Transactions on Industrial Informatics, 2019
- Distilling Object Detectors With Fine-Grained Feature Imitation2019
- Structured Knowledge Distillation for Semantic Segmentation2019
- A Method of Clustering Ensemble Based on Grey Relation AnalysisWireless Personal Communications, 2018
- Using GA-SVM for defect inspection of flip chips based on vibration signalsMicroelectronics Reliability, 2018
- Nondestructive diagnosis of flip chips based on vibration analysis using PCA-RBFMechanical Systems and Signal Processing, 2017
- Using SOM neural network for X-ray inspection of missing-bump defects in three-dimensional integrationMicroelectronics Reliability, 2015