Differentially Private Continual Releases of Streaming Frequency Moment Estimations
Preprint
Abstract
The streaming model of computation is a popular approach for working with large-scale data. In this setting, there is a stream of items and the goal is to compute the desired quantities (usually data statistics) while making a single pass through the stream and using as little space as possible. Motivated by the importance of data privacy, we develop differentially private streaming algorithms under the continual release setting, where the union of outputs of the algorithm at every timestamp must be differentially private. Specifically, we study the fundamental $\ell_p$ $(p\in [0,+\infty))$ frequency moment estimation problem under this setting, and give an $\varepsilon$-DP algorithm that achieves $(1+η)$-relative approximation $(\forall η\in(0,1))$ with $\mathrm{poly}\log(Tn)$ additive error and uses $\mathrm{poly}\log(Tn)\cdot \max(1, n^{1-2/p})$ space, where $T$ is the length of the stream and $n$ is the size of the universe of elements. Our space is near optimal up to poly-logarithmic factors even in the non-private setting. To obtain our results, we first reduce several primitives under the differentially private continual release model, such as counting distinct elements, heavy hitters and counting low frequency elements, to the simpler, counting/summing problems in the same setting. Based on these primitives, we develop a differentially private continual release level set estimation approach to address the $\ell_p$ frequency moment estimation problem. We also provide a simple extension of our results to the harder sliding window model, where the statistics must be maintained over the past $W$ data items.
Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- A Survey on Statistical, Information, and Estimation—Theoretic Views on PrivacyIEEE BITS the Information Theory Magazine, 2021
- High frequency moments via max-stability2017
- Pure Differential Privacy for Rectangle Queries via Private Partitions2015
- Private decayed predicate sums on streams2013
- The Johnson-Lindenstrauss Transform Itself Preserves Differential Privacy2012
- Smooth Histograms for Sliding Windows2007
- Stable distributions, pseudorandom generators, embeddings, and data stream computationJournal of the ACM, 2006
- An improved data stream summary: the count-min sketch and its applicationsJournal of Algorithms, 2005
- Maintaining Stream Statistics over Sliding WindowsSIAM Journal on Computing, 2002
- Finding repeated elementsScience of Computer Programming, 1982