Secure distributed data-mining and its application to large-scale network measurements
Authors:
Open Access
- 10 January 2006
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGCOMM Computer Communication Review
- Vol. 36 (1) , 7-14
Abstract
The rapid growth of the Internet over the last decade has been startling. However, efforts to track its growth have often fallen afoul of bad data --- for instance, how much traffic does the Internet now carry? The problem is not that the data is technically hard to obtain, or that it does not exist, but rather that the data is not shared. Obtaining an overall picture requires data from multiple sources, few of whom are open to sharing such data, either because it violates privacy legislation, or exposes business secrets. Likewise, detection of global Internet health problems is hampered by a lack of data sharing. The approaches used so far in the Internet, e.g. trusted third parties, or data anonymization, have been only partially successful, and are not widely adopted.The paper presents a method for performing computations on shared data without any participants revealing their secret data . For example, one can compute the sum of traffic over a set of service providers without any service provider learning the traffic of another. The method is simple, scalable, and flexible enough to perform a wide range of valuable operations on Internet data.Keywords
This publication has 24 references indexed in Scilit:
- Space efficient mining of multigraph streams2005
- Privacy-Preserving Graph Algorithms in the Semi-honest Model2005
- State-of-the-art in privacy preserving data miningACM SIGMOD Record, 2004
- An Improved Data Stream Summary: The Count-Min Sketch and Its Applications2004
- Automatically inferring patterns of resource consumption in network traffic2003
- Fast accurate computation of large-scale IP traffic matrices from link loads2003
- Sketch-based change detection2003
- Tools for privacy preserving distributed data miningACM SIGKDD Explorations Newsletter, 2002
- NetScope: traffic engineering for IP networksIEEE Network, 2000
- How to share a secretCommunications of the ACM, 1979