Variational Graph Attention Networks With Self-Supervised Learning for Multivariate Time Series Anomaly Detection
- 20 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-13
Abstract
Cyber-physical systems (CPSs) are multidimensional and complex systems that integrate computing, networking, and physical environment, including various sensors that can produce vast multivariate time series data. Recently, scholars have proposed many unsupervised anomaly detection methods to monitor and alarm potential faults of CPSs. However, current methods still have some limitations. First of all, it is challenging to capture spatial-temporal relationships explicitly. In the second place, the anomaly detection model based on the variational autoencoder (VAE) may not use the latent variable and often falls into a kind of collapse, which is encouraged by the Kullback–Leibler (KL) divergence term. In the end, more information about the anomalies is needed. This article proposes a novel anomaly detection method called variational graph attention networks with self-supervised learning (VGATSL). We use stacked spatial-temporal graph attention (STGAT) networks to capture the temporal and feature correlations. Next, a VAE is constructed based on bidirectional gated recurrent units (BiGRUs), and the von Mises-Fisher (vMF) distribution is used as its latent space. Indeed, this distribution places latent representation on the surface of a unit hypersphere to allow for uninformed priors, thus preventing the model collapse. Additionally, self-supervised learning is introduced to simulate abnormal behaviors and to help the model form more explicit normality boundaries. Extensive experiments on three public real-world datasets demonstrate that VGATSL outperforms the baseline methods. We also illustrate that VGATSL has superior interpretability and flexibility.Keywords
Funding Information
- National Natural Science Foundation of China (62471252)
- National Natural Science Foundation of China (62172235)
- National Natural Science Foundation of China (62402242)
- Primary Research & Development Plan of Jiangsu Province (BE2023025)
- Natural Science Research Project of Jiangsu Higher Education Institutions (22KJB520028)
This publication has 59 references indexed in Scilit:
- Anomaly detection for key performance indicators by fusing self-supervised spatio-temporal graph attention networksKnowledge-Based Systems, 2024
- Variance discrepancy representation: A vibration characteristic-guided distribution alignment metric for fault transfer diagnosisMechanical Systems and Signal Processing, 2024
- Multivariate Time-Series Anomaly Detection with Temporal Self-supervision and Graphs: Application to Vehicle Failure Prediction2023
- Few-shot time-series anomaly detection with unsupervised domain adaptationInformation Sciences, 2023
- Maximum mean square discrepancy: A new discrepancy representation metric for mechanical fault transfer diagnosisKnowledge-Based Systems, 2023
- Graph neural networks: A review of methods and applicationsAI Open, 2020
- MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks2019
- Temporal Convolutional Networks for Action Segmentation and Detection2017
- Simulation of the von mises fisher distributionCommunications in Statistics - Simulation and Computation, 1994
- Dispersion on a SphereProceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 1953