New Attention Ensemble-Based Fault Diagnosis for Industrial Processes Under Imbalanced Finite Data
- 16 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 75 (00189456) , 1-8
Abstract
During industrial processes operation, fault diagnosis needs to rely on finite and imbalanced samples for learning because the equipment is usually in a normal operation state and the probability of faults is low. For this issue, we propose a new attention ensemble algorithm, DMSAM-OAdB. First, the multiscale sparse attention module (MSAM) extracts and fuses feature information from different scales to establish the correlation among features and adaptively adjusts the feature weights by soft thresholding operation to emphasize the critical features while filtering the redundant information. Subsequently, a deep network model (DMSAM) constructed by stacking multiple convolutional layers and MSAMs is iteratively trained as the base classifier for the optimized AdaBoost algorithm (OAdB). The OAdB dynamically increases the weights of misclassified samples while mitigating class imbalance by randomly zeroing out the weights of a certain number of correctly classified majority class samples. Finally, the improved focal loss (IFL) function enhances the model’s discrimination capability for minority class samples. Experiments on the industrial coking furnace validate the reliability and superiority of the proposed methodology.Keywords
This publication has 27 references indexed in Scilit:
- Transformer fault diagnosis technology based on AdaBoost enhanced transferred convolutional neural networkExpert Systems with Applications, 2024
- A literature review of fault diagnosis based on ensemble learningEngineering Applications of Artificial Intelligence, 2023
- WSAFormer-DFFN: A model for rotating machinery fault diagnosis using 1D window-based multi-head self-attention and deep feature fusion networkEngineering Applications of Artificial Intelligence, 2023
- A multi‐fault diagnosis method based on improved SMOTE for class‐imbalanced dataThe Canadian Journal of Chemical Engineering, 2022
- A novel deep learning model based on target transformer for fault diagnosis of chemical processProcess Safety and Environmental Protection, 2022
- Ensemble deep learning: A reviewEngineering Applications of Artificial Intelligence, 2022
- Multi-level features fusion network-based feature learning for machinery fault diagnosisApplied Soft Computing, 2022
- CFs-focused intelligent diagnosis scheme via alternative kernels networks with soft squeeze-and-excitation attention for fast-precise fault detection under slow & sharp speed variationsKnowledge-Based Systems, 2022
- Cost sensitive active learning using bidirectional gated recurrent neural networks for imbalanced fault diagnosisNeurocomputing, 2020
- Classifying imbalanced data using BalanceCascade-based kernelized extreme learning machinePattern Analysis and Applications, 2019