Hybrid Semiconductor Wafer Inspection Framework via Autonomous Data Annotation
- 9 May 2024
- journal article
- research article
- Published by ASME International in Journal of Manufacturing Science and Engineering
- Vol. 146 (7) , 1-34
Abstract
In smart manufacturing, semiconductors play an indispensable role in collecting, processing, and analyzing data, ultimately enabling more agile and productive operations. Given the foundational importance of wafers, the purity of a wafer is essential to maintain the integrity of the overall semiconductor fabrication. This study proposes a novel automated visual inspection (AVI) framework for scrutinizing semiconductor wafers from scratch, capable of identifying defective wafers and pinpointing the location of defects through autonomous data annotation. Initially, this proposed methodology leveraged a texture analysis method known as gray-level co-occurrence matrix (GLCM) that categorized wafer images—captured via a stroboscopic imaging system—into distinct scenarios for high- and low-resolution wafer images. GLCM approaches further allowed for a complete separation of low-resolution wafer images into defective and normal wafer images, as well as the extraction of defect images from defective low-resolution wafer images, which were used for training a convolutional neural network (CNN) model. Consequently, the CNN model excelled in localizing defects on defective low-resolution wafer images, achieving an F1 score—the harmonic mean of precision and recall metrics—exceeding 90.1%. In high-resolution wafer images, a background subtraction technique represented defects as clusters of white points. The quantity of these white points determined the defectiveness and pinpointed locations of defects on high-resolution wafer images. Lastly, the CNN implementation further enhanced performance, robustness, and consistency irrespective of variations in the ratio of white point clusters. This technique demonstrated accuracy in localizing defects on high-resolution wafer images, yielding an F1 score greater than 99.3%.Keywords
Funding Information
- National Science Foundation (CMMI-2124999)
This publication has 58 references indexed in Scilit:
- Improving automated visual fault inspection for semiconductor manufacturing using a hybrid multistage system of deep neural networksJournal of Intelligent Manufacturing, 2022
- Automated surface defect detection framework using machine vision and convolutional neural networksJournal of Intelligent Manufacturing, 2022
- Autoencoder-based anomaly detection of industrial robot arm using stethoscope based internal sound sensorJournal of Intelligent Manufacturing, 2021
- Defective wafer detection using a denoising autoencoder for semiconductor manufacturing processesAdvanced Engineering Informatics, 2020
- Anomaly detection of defects on concrete structures with the convolutional autoencoderAdvanced Engineering Informatics, 2020
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationInternational Journal of Computer Vision, 2019
- Machine learning-based imaging system for surface defect inspectionInternational Journal of Precision Engineering and Manufacturing-Green Technology, 2016
- Smart manufacturing: Past research, present findings, and future directionsInternational Journal of Precision Engineering and Manufacturing-Green Technology, 2016
- 3D imaging application in the studies of micro air vehiclesComputers in Industry, 2013
- High-speed imaging in fluidsExperiments in Fluids, 2013