Masked Autoencoder via End-to-End Zero-Shot Learning for Fault Diagnosis of Unseen Classes
- 7 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-10
Abstract
This study confronts a demanding fault diagnosis task where no sensor signals from the target faults can be utilized for model training. Considering semantic descriptions of the target (or unseen) faults may be known in advance, zero-shot learning (ZSL) is employed to solve the zero-sample fault diagnosis task. Most of existing ZSL methods designed for computer vision tasks rely on pre-extracted features generated by a powerful feature extractor. However, collecting a large amount of fault data in advance for training a powerful and universal fault feature extractor is impractical. To overcome this problem, we propose a masked autoencoder via end-to-end zero-shot learning (MAE_EZSL) approach consisting of four steps, which are self-supervised masked autoencoder pretraining, shared latent space learning, zero shot classifier training, and unseen faults detection. The essence of our approach lies in the comprehensive utilization of masked autoencoders to deeply explore the features of seen faults. Subsequently, we align the distributions learned from sensor signals and fault semantic information to construct essential features associated with unseen faults. Experiments were meticulously conducted to assess the performance of the MAE_EZSL approach using datasets obtained from a benchmark bearing and a specialized test-rig. The obtained results demonstrate that the proposed MAE_EZSL method exhibits competitive performance when compared to state-of-the-art zero-shot learning algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (72171049, 52175080)
- Young Elite Scientists Sponsorship Program by China Association for Science and Technology (2022QNRC001)
- Basic and Applied Basic Research Foundation of Guangdong Province (2023A1515140186, 2022A1515012004)
- Innovation Team of Intelligent Operation and Maintenance for High-End Equipment (2023KCXTDO39)
This publication has 28 references indexed in Scilit:
- Sliced Wasserstein cycle consistency generative adversarial networks for fault data augmentation of an industrial robotExpert Systems with Applications, 2023
- Research on fault diagnosis method of MS-CNN rolling bearing based on local central moment discrepancyAdvanced Engineering Informatics, 2022
- Semi-supervised multi-scale attention-aware graph convolution network for intelligent fault diagnosis of machine under extremely-limited labeled samplesJournal of Manufacturing Systems, 2022
- Zero-shot learning for compound fault diagnosis of bearingsExpert Systems with Applications, 2022
- Unsupervised domain-share CNN for machine fault transfer diagnosis from steady speeds to time-varying speedsJournal of Manufacturing Systems, 2022
- Attitude data-based deep hybrid learning architecture for intelligent fault diagnosis of multi-joint industrial robotsJournal of Manufacturing Systems, 2021
- Applications of machine learning to machine fault diagnosis: A review and roadmapMechanical Systems and Signal Processing, 2020
- Semi-supervised gear fault diagnosis using raw vibration signal based on deep learningChinese Journal of Aeronautics, 2020
- A novel deep autoencoder feature learning method for rotating machinery fault diagnosisMechanical Systems and Signal Processing, 2017
- An Embarrassingly Simple Approach to Zero-Shot Learning2017