Estimating flow distributions from sampled flow statistics
Authors:
- 7 November 2005
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Networking
- Vol. 13 (5) , 933-946
Abstract
Passive traffic measurement increasingly employs sampling at the packet level. Many high-end routers form flow statistics from a sampled substream of packets. Sampling controls the consumption of resources by the measurement operations. However, knowledge of the statistics of flows in the unsampled stream remains useful, for understanding both characteristics of source traffic, and consumption of resources in the network. This paper provides methods that use flow statistics formed from sampled packet stream to infer the frequencies of the number of packets per flow in the unsampled stream. A key task is to infer the properties of flows of original traffic that evaded sampling altogether. We achieve this through statistical inference, and by exploiting protocol level detail reported in flow records. We investigate the impact on our results of different versions of packet sampling.Keywords
This publication has 19 references indexed in Scilit:
- Estimating flow distributions from sampled flow statisticsIEEE/ACM Transactions on Networking, 2005
- Building a better NetFlow2004
- Inverting sampled traffic2003
- New directions in traffic measurement and accounting2002
- Charging from sampled network usage2001
- Performance of Web proxy caching in heterogeneous bandwidth environments1999
- Efficient policies for carrying Web traffic over flow-switched networksIEEE/ACM Transactions on Networking, 1998
- A parameterizable methodology for Internet traffic flow profilingIEEE Journal on Selected Areas in Communications, 1995
- Empirically derived analytic models of wide-area TCP connectionsIEEE/ACM Transactions on Networking, 1994
- Application of sampling methodologies to network traffic characterization1993