Changepoint-Based Anomaly Detection for Prognostic Diagnosis in a Core Router System
- 12 June 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Vol. 38 (7) , 1331-1344
Abstract
Prognostic diagnosis is desirable for commercial core router systems to ensure early failure prediction and fast error recovery. The effectiveness of prognostic diagnosis depends on whether anomalies can be accurately detected before a failure occurs. However, traditional anomaly detection techniques fail to detect “outliers” when the statistical properties of the monitored data change significantly as time proceeds. We describe the design of a changepoint-based anomaly detector that first detects changepoints from collected time-series data, and then utilizes these changepoints to detect anomalies. Different changepoint detection approaches are implemented to detect various types of changepoints. A clustering method is then developed to identify normal/abnormal patterns from changepoint windows. Data collected from a set of commercial core router systems are used to validate the proposed anomaly detector. Experimental results show that our changepoint-based anomaly detector achieves better performance than traditional methods in terms of two metrics, namely success ratio and non-false-alarm ratio.Keywords
Funding Information
- Huawei Technologies
This publication has 27 references indexed in Scilit:
- Change-point detection in time-series data by relative density-ratio estimationNeural Networks, 2013
- A Survey of Outlier Detection Methods in Network Anomaly IdentificationThe Computer Journal, 2011
- Anomaly detectionACM Computing Surveys, 2009
- An overview of anomaly detection techniques: Existing solutions and latest technological trendsComputer Networks, 2007
- Monitoring the Formation of Kernel-Based Topographic Maps in a Hybrid SOM-kMER ModelIEEE Transactions on Neural Networks, 2006
- Network Reliability and Fault Tolerance2003
- Use of K-Nearest Neighbor classifier for intrusion detectionComputers & Security, 2002
- R.A. Fisher and the making of maximum likelihood 1912-1922Statistical Science, 1997
- Support-vector networksMachine Learning, 1995
- A Cluster Analysis Method for Grouping Means in the Analysis of Variance1974