Bayesian Differentiable Architecture Search for Efficient Domain Matching Fault Diagnosis
- 29 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456) , 1-11
Abstract
Intelligent fault diagnosis is essential for downtime reduction in modern industries. However, domain (i.e., working condition) variants are unavoidable for fault diagnosis under changing environment. Though one can obtain a customized deep learning model for a given domain, it is not practical to design deep neural networks manually for multiple domains. Differentiable architecture search (DARTS), as an automatic machine learning technique, can automate the network design process for a specific domain efficiently by using hypernetwork and differentiable search strategy. Nevertheless, the representation of hypernetwork is restricted by several unfair factors, and the searched architecture of DARTS is overconfident. To address these issues, a one-shot neural architecture search approach, which involves two-stage learning, is proposed for efficient domain matching fault diagnosis. In the first training stage, the warmup and path-dropout strategies are taken to enhance the competitiveness of the parametric operators and alleviate the coadaptation problem to obtain an intuitively fair hypernetwork. In the second matching stage, variational inference is introduced into a differentiable search strategy to estimate the uncertainty of model matching, and a scale mixture prior is used to softly constrain the matching stage. Then, a candidate architectures set can be sampled and ordered from the posterior. Multidomain experiment is implemented by adding noise to the raw signal, and the proposed method outperforms four commonly used deep neural networks for aeroengine bevel gear fault diagnosis.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFB1702400)
- National Natural Science Foundation of China (51835009)
- Fundamental Research Funds of China Central Universities (xzd02019038)
This publication has 18 references indexed in Scilit:
- A reinforcement neural architecture search method for rolling bearing fault diagnosisMeasurement, 2020
- Regularized Evolution for Image Classifier Architecture SearchProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Data-Driven Fault Diagnosis Method Based on Compressed Sensing and Improved Multiscale NetworkIEEE Transactions on Industrial Electronics, 2019
- Some further thoughts about spectral kurtosis, spectral L2/L1 norm, spectral smoothness index and spectral Gini index for characterizing repetitive transientsMechanical Systems and Signal Processing, 2018
- Enhanced Sparse Period-Group Lasso for Bearing Fault DiagnosisIEEE Transactions on Industrial Electronics, 2018
- Spectral L2/L1 norm: A new perspective for spectral kurtosis for characterizing non-stationary signalsMechanical Systems and Signal Processing, 2018
- Intelligent Bearing Fault Diagnosis Method Combining Compressed Data Acquisition and Deep LearningIEEE Transactions on Instrumentation and Measurement, 2017
- Stacked Multilevel-Denoising Autoencoders: A New Representation Learning Approach for Wind Turbine Gearbox Fault DiagnosisIEEE Transactions on Instrumentation and Measurement, 2017
- Towards Bayesian Deep Learning: A Framework and Some Existing MethodsIEEE Transactions on Knowledge and Data Engineering, 2016
- Comparing Measures of SparsityIEEE Transactions on Information Theory, 2009