Histogram-based traffic anomaly detection
Authors:
- 1 June 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 6 (2) , 110-121
Abstract
Identifying network anomalies is essential in enterprise and provider networks for diagnosing events, like attacks or failures, that severely impact performance, security, and Service Level Agreements (SLAs). Feature-based anomaly detection models (ab)normal network traffic behavior by analyzing different packet header features, like IP addresses and port numbers. In this work, we describe a new approach to feature-based anomaly detection that constructs histograms of different traffic features, models histogram patterns, and identifies deviations from the created models. We assess the strengths and weaknesses of many design options, like the utility of different features, the construction of feature histograms, the modeling and clustering algorithms, and the detection of deviations. Compared to previous feature-based anomaly detection approaches, our work differs by constructing detailed histogram models, rather than using coarse entropy-based distribution approximations. We evaluate histogram-based anomaly detection and compare it to previous approaches using collected network traffic traces. Our results demonstrate the effectiveness of our technique in identifying a wide range of anomalies. The assessed technical details are generic and, therefore, we expect that the derived insights will be useful for similar future research efforts.Keywords
This publication has 17 references indexed in Scilit:
- Anomaly detectionACM Computing Surveys, 2009
- Histogram Matrix: Log File Visualization for Anomaly Detection2008
- WebClassACM SIGCOMM Computer Communication Review, 2008
- A Two-Layered Anomaly Detection Technique Based on Multi-modal Flow Behavior ModelsLecture Notes in Computer Science, 2008
- Detectability of Traffic Anomalies in Two Adjacent Networks2007
- Non-Gaussian and Long Memory Statistical Characterizations for Internet Traffic with AnomaliesIEEE Transactions on Dependable and Secure Computing, 2007
- Impact of packet sampling on anomaly detection metrics2006
- Entropy Based Worm and Anomaly Detection in Fast IP Networks2006
- Diagnosing network-wide traffic anomalies2004
- A dendrite method for cluster analysisCommunications in Statistics, 1974