Unraveling the ‘Anomaly’ in Time Series Anomaly Detection: A Self-supervised Tri-domain Solution
Authors:
- 13 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 981-994
Abstract
The ongoing challenges in time series anomaly detection (TSAD), including the scarcity of anomaly labels and the variability in anomaly lengths and shapes, have led to the need for a more robust and efficient solution. As limited anomaly labels hinder traditional supervised models in anomaly detection, various state-of-the-art (SOTA) deep learning (DL) techniques (e.g., self-supervised learning) are introduced to tackle this issue. However, they encounter difficulties handling variations in anomaly lengths and shapes, limiting their adaptability to diverse anomalies. Additionally, many benchmark datasets suffer from the problem of having explicit anomalies that even random functions can detect. This problem is exacerbated by an ill-posed evaluation metric, known as point adjustment (PA), which results in inflated model performance. In this context, we propose a novel self-supervised learning based Tri-domain Anomaly Detector (TriAD), which addresses these challenges by modeling features across three aspects - temporal, frequency, and residual domains - without relying on anomaly labels. Unlike traditional contrastive learning methods, TriAD employs both inter-domain and intra-domain contrastive loss to learn common attributes among normal data and differentiate them from anomalies. Additionally, our approach can detect anomalies of varying lengths by integrating with a discord discovery algorithm. It is worth noting that this study is the first to reevaluate the DL potential in TSAD, utilizing both rigorously designed datasets and evaluation metrics. Experimental results demonstrate that TriAD achieves a consistent and significant performance increase over both DL and non-DL SOTA baselines. Moreover, in comparison to SOTA discord discovery algorithms, TriAD improves anomaly detection accuracy by 50 % while cutting the inference time down to just one-tenth. Illuminating the significance of rigorous datasets and evaluation metrics, this paper offers a new direction for addressing the multifaceted challenges of TSAD. The source code is publicly available at https://github.com/pseudo-Skye/TriAD.Keywords
All Related Versions
Funding Information
- Australian Research Council (FT210100624)
This publication has 66 references indexed in Scilit:
- TSI-GAN: Unsupervised Time Series Anomaly Detection Using Convolutional Cycle-Consistent Generative Adversarial Networks2023
- Spatial-temporal meta-path guided explainable crime predictionWorld Wide Web, 2023
- MERLIN++: parameter-free discovery of time series anomaliesData Mining and Knowledge Discovery, 2023
- DAMP: accurate time series anomaly detection on trillions of datapoints and ultra-fast arriving data streamsData Mining and Knowledge Discovery, 2023
- Semi-supervised automatic seizure detection using personalized anomaly detecting variational autoencoder with behind-the-ear EEGComputer Methods and Programs in Biomedicine, 2022
- Fast-adapting and privacy-preserving federated recommender systemThe VLDB Journal, 2021
- Detecting voids in 3D printing using melt pool time series dataJournal of Intelligent Manufacturing, 2020
- Time series joins, motifs, discords and shapelets: a unifying view that exploits the matrix profileData Mining and Knowledge Discovery, 2017
- Prediction of multivariate chaotic time series with local polynomial fittingComputers & Mathematics with Applications, 2010
- Disk aware discord discovery: finding unusual time series in terabyte sized datasetsKnowledge and Information Systems, 2008