CAT: Beyond Efficient Transformer for Content-Aware Anomaly Detection in Event Sequences
Authors:
Open Access
- 14 August 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 4541-4550
Abstract
It is critical and important to detect anomalies in event sequences, which becomes widely available in many application domains. Indeed, various efforts have been made to capture abnormal patterns from event sequences through sequential pattern analysis or event representation learning. However, existing approaches usually ignore the semantic information of event content. To this end, in this paper, we propose a self-attentive encoder-decoder transformer framework, Content-Aware Transformer CAT, for anomaly detection in event sequences. In CAT, the encoder learns preamble event sequence representations with content awareness, and the decoder embeds sequences under detection into a latent space, where anomalies are distinguishable. Specifically, the event content is first fed to a content-awareness layer, generating representations of each event. The encoder accepts preamble event representation sequence, generating feature maps. In the decoder, an additional token is added at the beginning of the sequence under detection, denoting the sequence status. A one-class objective together with sequence reconstruction loss is collectively applied to train our framework under the label efficiency scheme. Furthermore, CAT is optimized under a scalable and efficient setting. Finally, extensive experiments on three real-world datasets demonstrate the superiority of CAT.Keywords
Funding Information
- NSF (National Science Foundation) (III-2006387, III-2040799, III-1814510)
This publication has 23 references indexed in Scilit:
- DeepLog2017
- Ramp loss K-Support Vector Classification-Regression; a robust and sparse multi-class approach to the intrusion detection problemKnowledge-Based Systems, 2017
- Log clustering based problem identification for online service systems2016
- A Survey of Distance and Similarity Measures Used Within Network Intrusion Anomaly DetectionIEEE Communications Surveys & Tutorials, 2014
- Glove: Global Vectors for Word Representation2014
- Dimensions of Cyber-Attacks: Cultural, Social, Economic, and PoliticalIEEE Technology and Society Magazine, 2011
- Detecting large-scale system problems by mining console logs2009
- Similarity Measures for Categorical Data: A Comparative Evaluation2008
- Detecting intrusions using system calls: alternative data models2003
- LOF2000