Internet Traffic Classification Using Constrained Clustering
- 13 December 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 25 (11) , 2932-2943
Abstract
Statistics-based Internet traffic classification using machine learning techniques has attracted extensive research interest lately, because of the increasing ineffectiveness of traditional port-based and payload-based approaches. In particular, unsupervised learning, that is, traffic clustering, is very important in real-life applications, where labeled training data are difficult to obtain and new patterns keep emerging. Although previous studies have applied some classic clustering algorithms such as K-Means and EM for the task, the quality of resultant traffic clusters was far from satisfactory. In order to improve the accuracy of traffic clustering, we propose a constrained clustering scheme that makes decisions with consideration of some background information in addition to the observed traffic statistics. Specifically, we make use of equivalence set constraints indicating that particular sets of flows are using the same application layer protocols, which can be efficiently inferred from packet headers according to the background knowledge of TCP/IP networking. We model the observed data and constraints using Gaussian mixture density and adapt an approximate algorithm for the maximum likelihood estimation of model parameters. Moreover, we study the effects of unsupervised feature discretization on traffic clustering by using a fundamental binning method. A number of real-world Internet traffic traces have been used in our evaluation, and the results show that the proposed approach not only improves the quality of traffic clusters in terms of overall accuracy and per-class metrics, but also speeds up the convergence.Keywords
This publication has 22 references indexed in Scilit:
- Network Traffic Classification Using Correlation InformationIEEE Transactions on Parallel and Distributed Systems, 2012
- Timely and Continuous Machine-Learning-Based Classification for Interactive IP TrafficIEEE/ACM Transactions on Networking, 2012
- A novel semi-supervised approach for network traffic clustering2011
- Digging into HTTPS2010
- Support Vector Machines for TCP traffic classificationComputer Networks, 2009
- Supervised Learning Real-time Traffic ClassifiersJournal of Networks, 2009
- Traffic classification through simple statistical fingerprintingACM SIGCOMM Computer Communication Review, 2007
- Bayesian Neural Networks for Internet Traffic ClassificationIEEE Transactions on Neural Networks, 2007
- Internet traffic classification using bayesian analysis techniquesACM SIGMETRICS Performance Evaluation Review, 2005
- Class-of-service mapping for QoS2004