ALSR: An Adaptive Label Screening and Relearning Approach for Anomaly Detection
Authors:
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Anomaly detection using KPIs (Key Performance Indicators) is key to AIOps (Artificial Intelligence for IT Operations). Recent anomaly detection approaches have adopted machine learning to detect anomalies on the perspective of individual time points more than events. These approaches do not make effective use of the labels of continuous anomaly intervals, nor do they pay attention to the differences among anomaly points. The detection performance is therefore not high enough. In this paper, we propose an anomaly detection approach named ALSR, which uses a label screening model and a relearning model to analyze and utilize the continuous anomaly intervals of KPIs in finer granularity. The label screening algorithm takes advantage of the continuity of anomaly intervals to remove unnecessary data from the training set, so as to better suit to interval-oriented anomaly detection. The relearning algorithm reclassifies the true/false positive points within range of detected anomalies, thus effectively reduces the number of false positive points. ALSR uses statistical characteristics and time series models for feature extraction, and the feature set is proved to better describe the characteristics of KPIs. We conduct comprehensive experiments on 25 KPIs, and the total F-score of ALSR is 0.965, which outperforms state-of-the-art anomaly detection approaches.Keywords
This publication has 12 references indexed in Scilit:
- High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learningPattern Recognition, 2016
- ARIMA Based Network Anomaly Detection2010
- On-line Random Forests2009
- Accurate anomaly detection through parallelismIEEE Network, 2009
- Network Anomaly Detection Based on Wavelet AnalysisEURASIP Journal on Advances in Signal Processing, 2008
- Adaptive Kalman Filtering for anomaly detection in software appliances2008
- Application of anomaly detection algorithms for detecting SYN flooding attacksComputer Communications, 2006
- Detecting anomalies in network traffic using maximum entropy estimation2005
- Change-point monitoring for the detection of DoS attacksIEEE Transactions on Dependable and Secure Computing, 2004
- Sketch-based change detection2003