Handling Imbalanced Datasets for Robust Deep Neural Network-Based Fault Detection in Manufacturing Systems
Open Access
- 20 October 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (21) , 9783
Abstract
Over the recent years, Industry 4.0 (I4.0) technologies such as the Industrial Internet of Things (IIoT), Artificial Intelligence (AI), and the presence of Industrial Big Data (IBD) have helped achieve intelligent Fault Detection (FD) in manufacturing. Notably, data-driven approaches in FD apply Deep Learning (DL) techniques to help generate insights required for monitoring complex manufacturing processes. However, due to the ratio of instances where actual faults occur, FD datasets tend to be imbalanced, leading to training challenges that result in inefficient DL-based FD models. In this paper, we propose Dual Logits Weights Perturbation (DLWP) loss, a method featuring weight vectors for improved dataset generalization in FD systems. The weight vectors act as hyperparameters adjusted on a case-by-case basis to regulate focus accorded to individual minority classes during training. In particular, our proposed method is suitable for imbalanced datasets from safety-related FD tasks as it generates DL models that minimize false negatives. Subsequently, we integrate human experts into the workflow as a strategy to help safeguard the system. A subset of the results, model predictions with uncertainties exceeding a preset threshold, are considered a preliminary output subject to cross-checking by human experts. We demonstrate that DLWP achieves improved Recall, AUC, F1 scores.Keywords
Funding Information
- Science Foundation Ireland (SFI/16/RC/3918 (Confirm), SFI 12/RC/2289_P2 (Insight).)
This publication has 58 references indexed in Scilit:
- Fault diagnosis using contribution plots without smearing effect on non-faulty variablesJournal of Process Control, 2012
- Towards Robustness in Neural Network Based Fault DiagnosisInternational Journal of Applied Mathematics and Computer Science, 2008
- An introduction to ROC analysisPattern Recognition Letters, 2006
- A review of process fault detection and diagnosisComputers & Chemical Engineering, 2003
- A review of process fault detection and diagnosisComputers & Chemical Engineering, 2003
- A review of process fault detection and diagnosisComputers & Chemical Engineering, 2003
- A mathematical theory of communicationACM SIGMOBILE Mobile Computing and Communications Review, 2001
- MetaNet*: The Theory of Independent JudgesSubstance Use & Misuse, 1998
- Fuzzy logic and neural network applications to fault diagnosisInternational Journal of Approximate Reasoning, 1997
- Basic principles of ROC analysisSeminars in Nuclear Medicine, 1978