Adversarial Multimodal Contrastive Learning for Robust Industrial Fault Diagnosis
- 18 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-12
Abstract
Fault diagnosis (FD) techniques leveraging self-supervised contrastive learning (SSCL) have demonstrated significant potential in industrial scenarios due to their reduced dependence on manually annotated data. However, the existing SSCL algorithms primarily focus on establishing complex similarity relationships among unimodal augmented views. These unimodal SSCL approaches are particularly vulnerable to learning shallow, domain-dependent spurious features in the training data rather than more intrinsic and essential features. Consequently, such spurious features may cause the algorithm failure when encountering distribution shift issues resulting from environmental perturbations or changes in working conditions. To address this challenge, we propose adversarial multimodal contrastive learning (AMMCL), a novel approach designed to extract robust and generalizable multimodal representations from time series and their corresponding spectrograms. AMMCL utilizes intermodal contrastive learning and adversarial training strategy to align modal-invariant features from both elementwise and setwise perspectives. These essential features are beneficial for intradomain and cross-domain FD tasks. Furthermore, a slice segmentation processing (SSP) method based on dominant frequency is employed to enhance model’s ability to recognize varying patterns within time series. AMMCL is first evaluated on intradomain and cross-domain FD tasks using the Gearbox and XJTU-SY datasets, where it outperforms nine existing FD algorithms in terms of performance. Additionally, AMMCL is compared with ten other valve stiction detection algorithms on International Stiction Database (ISDB) dataset, successfully identifying the most loop states (23 out of 26). Finally, the trained AMMCL model on the ISDB dataset is implemented in actual industrial valve detection, demonstrating the feasibility and practicality of AMMCL in real industrial scenarios.Keywords
Funding Information
- Key Research and Development Project of Zhejiang Province (2024C01172)
- Young Scientists Fund of National Natural Science Foundation of China (62503419)
This publication has 36 references indexed in Scilit:
- Bridging the gap between AI and the industry — A study on bearing fault detection in PMSM-driven systems using CNN and inverter measurementEngineering Applications of Artificial Intelligence, 2023
- Learning from the global view: Supervised contrastive learning of multimodal representationInformation Fusion, 2023
- Adversarial domain adaptation using contrastive learningEngineering Applications of Artificial Intelligence, 2023
- Self-supervised feature extraction via time–frequency contrast for intelligent fault diagnosis of rotating machineryMeasurement, 2023
- Neural architecture search algorithm to optimize deep Transformer model for fault detection in electrical power distribution systemsEngineering Applications of Artificial Intelligence, 2023
- Hydrogenerator early fault detection: Sparse Dictionary Learning jointly with the Variational AutoencoderEngineering Applications of Artificial Intelligence, 2023
- A simple model-free butterfly shape-based detection (BSD) method integrated with deep learning CNN for valve stiction detection and quantificationJournal of Process Control, 2020
- Comprehensive methodology for detection and diagnosis of oscillatory control loopsControl Engineering Practice, 2009
- A comparison of techniques for automatic detection of stiction: simulation and application to industrial dataJournal of Process Control, 2005
- A simple method for detecting valve stiction in oscillating control loopsJournal of Process Control, 2005