Measuring large-scale distributed systems: case of BitTorrent Mainline DHT
- 1 September 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21613559,p. 1-10
Abstract
Peer-to-peer networks have been quite thoroughly measured over the past years, however it is interesting to note that the BitTorrent Mainline DHT has received very little attention even though it is by far the largest of currently active overlay systems, as our results show. As Mainline DHT differs from other systems, existing measurement methodologies are not appropriate for studying it. In this paper we present an efficient methodology for estimating the number of active users in the network. We have identified an omission in previous methodologies used to measure the size of the network and our methodology corrects this. Our method is based on modeling crawling inaccuracies as a Bernoulli process. It guarantees a very accurate estimation and is able to provide the estimate in about 5 seconds. Through experiments in controlled situations, we demonstrate the accuracy of our method and show the causes of the inaccuracies in previous work, by reproducing the incorrect results. Besides accurate network size estimates, our methodology can be used to detect network anomalies, in particular Sybil attacks in the network. We also report on the results from our measurements which have been going on for almost 2.5 years and are the first long-term study of Mainline DHT.Keywords
This publication has 16 references indexed in Scilit:
- Real-world sybil attacks in BitTorrent mainline DHT2012
- On blind mice and the elephant2011
- BitMON: A Tool for Automated Monitoring of the BitTorrent DHT2010
- BitTorrent Darknets2010
- Long Term Study of Peer Behavior in the kad DHTIEEE/ACM Transactions on Networking, 2009
- Active and passive techniques for group size estimation in large-scale and dynamic distributed systemsJournal of Systems and Software, 2007
- Understanding churn in peer-to-peer networks2006
- Capturing accurate snapshots of the gnutella network2005
- The Bittorrent P2P File-Sharing System: Measurements and Analysis2005
- Dissecting BitTorrent: Five Months in a Torrent’s Lifetime2004