An Enhanced YOLOv4 Model With Self-Dependent Attentive Fusion and Component Randomized Mosaic Augmentation for Metal Surface Defect Detection
Authors:
Open Access
- 31 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 97758-97766
Abstract
Metal surface quality control is significant in the production line of metal products. Detecting metal surface defects is challenging due to the various types and morphological patterns. Recent advances have witnessed deep learning-based automated optical inspection systems as a promising solution. This paper presents an enhanced YOLOv4 model for metal surface defect detection (MSDD). Specifically, we integrate three boosting components into the original YOLOv4, including 1) a self-dependent attentive fusion (SAF) block, placed within the model neck, to enhance inter-path and cross-layer feature fusion, 2) a component randomized Mosaic augmentation (CRMA) scheme to strategically discourage an over-transformed image to participate in training, and 3) a perturbation agnostic (PA) label smoothing method to keep the model from making over-confident predictions and thus act as a means of regularization. The proposed method has been validated on a self-developed MSDD dataset. It is shown that each boosting component can lead to an impressive mAP gain, and the final model outperforms the baselines, namely, Faster R-CNN, YOLOv4, YOLOv5, and YOLOX, by 7.85%, 6.51%, 3.76%, and 3.57%, respectively.Keywords
This publication has 30 references indexed in Scilit:
- Feature Pyramid Networks for Object Detection2017
- YOLO9000: Better, Faster, Stronger2017
- An inspection approach for casting defects detection using image segmentation2017
- Light source optimization for automatic visual inspection of piston surface defectsThe International Journal of Advanced Manufacturing Technology, 2016
- Deep Residual Learning for Image Recognition2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Detection and classification of surface defects of gun barrels using computer vision and machine learningMeasurement, 2015
- Metal surface defect detection using iterative thresholding technique2014
- Defect inspection system for steel wire rods produced by hot rolling processThe International Journal of Advanced Manufacturing Technology, 2013