A Lightweight 1D-CNN-Transformer for Bearing Fault Diagnosis Under Limited Data and AWGN Interference
Top Cited Papers
Open Access
Abstract
Intelligent bearing fault diagnosis is essential for maintaining the reliability of rotating machinery. However, deploying deep learning models in industrial environments is often constrained by a lack of labeled data, environmental noise, and strict hardware limits. To address these connected challenges, this paper proposes 1D-CNN-Trans, a flexible and resource-efficient hybrid framework. Designed for supervised diagnosis with restricted data, the configurable model combines a compact one-dimensional convolutional neural network (1D-CNN) for local feature extraction, a Transformer encoder for capturing long-range temporal dependencies, and an optional squeeze-and-excitation (SE) module for channel recalibration under favorable conditions. The method is evaluated on two standard mechanical benchmarks under limited sample conditions, controlled additive white Gaussian noise (AWGN), and dynamic non-stationary interference. Experimental results indicate that 1D-CNN-Trans shows improved robustness under interference compared to selected baselines, notably improving accuracy against a standard CNN backbone. Furthermore, findings indicate that while the Transformer ensures noise robustness, channel recalibration (via SE) introduces optimization instability under extreme sparsity and noise. Consequently, we reposition the architecture as a configurable framework where recalibration is conditionally activated. Finally, theoretical complexity analysis is provided to validate the model’s low computational burden, indicating its general feasibility for resource-constrained scenarios.Keywords
This publication has 29 references indexed in Scilit:
- A joint collaborative adaptation network for fault diagnosis of rolling bearing under class imbalance and variable operating conditionsAdvanced Engineering Informatics, 2025
- A physics-based sample generation method for few-shot bearing condition monitoringKnowledge-Based Systems, 2025
- A novel transformer-based few-shot learning method for intelligent fault diagnosis with noisy labels under varying working conditionsReliability Engineering & System Safety, 2024
- A strong anti-noise and easily deployable bearing fault diagnosis model based on time–frequency dual-channel TransformerMeasurement, 2024
- Fault diagnosis in rotating machines based on transfer learning: Literature reviewKnowledge-Based Systems, 2023
- C-ECAFormer: A new lightweight fault diagnosis framework towards heavy noise and small samplesEngineering Applications of Artificial Intelligence, 2023
- LiConvFormer: A lightweight fault diagnosis framework using separable multiscale convolution and broadcast self-attentionExpert Systems with Applications, 2023
- A review of the application of deep learning in intelligent fault diagnosis of rotating machineryMeasurement, 2022
- Multiple hierarchical compression for deep neural network toward intelligent bearing fault diagnosisEngineering Applications of Artificial Intelligence, 2022
- Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practiceReliability Engineering & System Safety, 2022