VAE-Based Interpretable Latent Variable Model for Process Monitoring
- 13 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35 (5) , 6075-6088
Abstract
Latent variable-based process monitoring (PM) models have been generously developed by shallow learning approaches, such as multivariate statistical analysis and kernel techniques. Owing to their explicit projection objectives, the extracted latent variables are usually meaningful and easily interpretable in mathematical terms. Recently, deep learning (DL) has been introduced to PM and has exhibited excellent performance because of its powerful presentation capability. However, its complex nonlinearity prevents it from being interpreted as human-friendly. It is a mystery how to design a proper network structure to achieve satisfactory PM performance for DL-based latent variable models (LVMs). In this article, a variational autoencoder-based interpretable LVM (VAE-ILVM) is developed for PM. Based on Taylor expansions, two propositions are proposed to guide the design of appropriate activation functions for VAE-ILVM, allowing nondisappearing fault impact terms contained in the generated monitoring metrics (MMs). During threshold learning, the sequence of counting that test statistics exceed the threshold is considered a martingale, a representative of weakly dependent stochastic processes. A de la Peña inequality is then adopted to learn a suitable threshold. Finally, two chemical examples verify the effectiveness of the proposed method. The use of de la Peña inequality significantly reduces the minimum required sample size for modeling.Keywords
Funding Information
- National Natural Science Foundation of China (92267205, U1911401)
- science and technology innovation Program of Hunan Province (2021RC4054)
- Changsha Social Laboratory of Artificial Intelligence
- Open Project of Xiangjiang Laboratory (22XJ03019)
- Scientific Research Fund of Hunan Provincial Education Department (22A0459)
This publication has 35 references indexed in Scilit:
- Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural NetworkIEEE Transactions on Instrumentation and Measurement, 2017
- Fault Detection for Non-Gaussian Processes Using Generalized Canonical Correlation Analysis and Randomized AlgorithmsIEEE Transactions on Industrial Electronics, 2017
- Nonlinear Process Fault Diagnosis Based on Serial Principal Component AnalysisIEEE Transactions on Neural Networks and Learning Systems, 2016
- Discriminative Feature Extraction by a Neural Implementation of Canonical Correlation AnalysisIEEE Transactions on Neural Networks and Learning Systems, 2015
- Deep learningNature, 2015
- Exponential inequalities for martingales with applicationsElectronic Journal of Probability, 2015
- A Neural Network-Based Multiplicative Actuator Fault Detection and Isolation of Nonlinear SystemsIEEE Transactions on Control Systems Technology, 2012
- Research on probabilistic methods for control system designAutomatica, 2011
- Nonlinear process monitoring using kernel principal component analysisChemical Engineering Science, 2004
- Feature vector selection and projection using kernelsNeurocomputing, 2003