A Large-Scale Hidden Semi-Markov Model for Anomaly Detection on User Browsing Behaviors
Authors:
- 12 May 2008
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Networking
- Vol. 17 (1) , 54-65
Abstract
Many methods designed to create defenses against distributed denial of service (DDoS) attacks are focused on the IP and TCP layers instead of the high layer. They are not suitable for handling the new type of attack which is based on the application layer. In this paper, we introduce a new scheme to achieve early attack detection and filtering for the application-layer-based DDoS attack. An extended hidden semi-Markov model is proposed to describe the browsing behaviors of web surfers. In order to reduce the computational amount introduced by the model's large state space, a novel forward algorithm is derived for the online implementation of the model based on the M-algorithm. Entropy of the user's HTTP request sequence fitting to the model is used as a criterion to measure the user's normality. Finally, experiments are conducted to validate our model and algorithm.Keywords
This publication has 17 references indexed in Scilit:
- Defense Against Spoofed IP Traffic Using Hop-Count FilteringIEEE/ACM Transactions on Networking, 2007
- User Centric Walk: An Integrated Approach for Modeling the Browsing Behavior of Users on the Web2005
- Distributed denial of service detection using TCP/IP header and traffic measurement analysis2005
- Combining the Web content and usage mining to understand the visitor behavior in a Web site2004
- Protection from distributed denial of service attacks using history-based IP filtering2004
- Recognizing objects in adversarial clutter: breaking a visual CAPTCHA2003
- An efficient forward-backward algorithm for an explicit-duration hidden Markov modelIEEE Signal Processing Letters, 2003
- Defending against flooding-based distributed denial-of-service attacks: a tutorialIEEE Communications Magazine, 2002
- Flash crowds and denial of service attacks2002
- Sequential Coding Algorithms: A Survey and Cost AnalysisIEEE Transactions on Communications, 1984