Anomaly Detection in Network Traffic Based on Statistical Inference and \alpha-Stable Modeling
Authors:
- Federico Simmross-WattenbergFSFederico Simmross-Wattenberg
- Juan Ignacio Asensio-PerezJAJuan Ignacio Asensio-Perez
- Pablo Casaseca-De-La-HigueraPCPablo Casaseca-De-La-Higuera
- Marcos Martin-FernandezMMMarcos Martin-Fernandez
- Ioannis A DimitriadisIDIoannis A Dimitriadis
- Carlos Alberola-LopezCACarlos Alberola-Lopez
- 17 February 2011
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Dependable and Secure Computing
- Vol. 8 (4) , 494-509
Abstract
This paper proposes a novel method to detect anomalies in network traffic, based on a nonrestricted α-stable first-order model and statistical hypothesis testing. To this end, we give statistical evidence that the marginal distribution of real traffic is adequately modeled with α-stable functions and classify traffic patterns by means of a Generalized Likelihood Ratio Test (GLRT). The method automatically chooses traffic windows used as a reference, which the traffic window under test is compared with, with no expert intervention needed to that end. We focus on detecting two anomaly types, namely floods and flash-crowds, which have been frequently studied in the literature. Performance of our detection method has been measured through Receiver Operating Characteristic (ROC) curves and results indicate that our method outperforms the closely-related state-of-the-art contribution described in. All experiments use traffic data collected from two routers at our university-a 25,000 students institution-which provide two different levels of traffic aggregation for our tests (traffic at a particular school and the whole university). In addition, the traffic model is tested with publicly available traffic traces. Due to the complexity of α-stable distributions, care has been taken in designing appropriate numerical algorithms to deal with the model.Keywords
This publication has 37 references indexed in Scilit:
- Evaluation of a low-rate DoS attack against application serversComputers & Security, 2008
- Hierarchical Kohonenen net for anomaly detection in network securityIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2005
- Is Network Traffic Appriximated by Stable Lévy Motion or Fractional Brownian Motion?The Annals of Applied Probability, 2002
- Network heavy traffic modeling using α-stable self-similar processesIEEE Transactions on Communications, 2001
- Anomaly detection in communication networks using waveletsIEE Proceedings - Communications, 2001
- Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source levelIEEE/ACM Transactions on Networking, 1997
- Wide area traffic: the failure of Poisson modelingIEEE/ACM Transactions on Networking, 1995
- On the self-similar nature of Ethernet traffic (extended version)IEEE/ACM Transactions on Networking, 1994
- Modification of the Kolmogorov-Smirnov Statistic for Use with Correlated DataJournal of the American Statistical Association, 1978
- Choosing between Logistic Regression and Discriminant AnalysisJournal of the American Statistical Association, 1978