Characterizing the System Overhead of Discrete Noise Generation for Differential Privacy
- 31 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 24 (2) , 345-348
Abstract
Differential privacy (DP) has become a de facto standard in restricting data leakage when releasing statistical information. It is widely used in data-centric applications, ranging from the US Census Bureau's population data collection to modern deep learning training. Recent studies have shown that using floating-point in implementing DP can significantly degrade its mathematical guarantees and strongly advised to use an integer-based implementation instead. However, nearly all popular DP libraries currently use floating-point. In this paper, we characterize the performance of a recent integer-based DP library from Google. Our study reveals that the noise generation is significantly slower (by 187–296×) when using an integer-based implementation, and that noise sampling can become a non negligible overhead in real applications. Our findings highlight an overlooked but important overhead in realizing high-privacy DP and call for greater focus from the communityKeywords
This publication has 7 references indexed in Scilit:
- LazyDP: Co-Designing Algorithm-Software for Scalable Training of Differentially Private Recommendation Models2024
- Federated Learning of Gboard Language Models with Differential Privacy2023
- Discrete Gaussian for Differential PrivacyJournal of Privacy and Confidentiality, 2022
- Randomness Concerns when Deploying Differential Privacy2020
- Deep Learning with Differential Privacy2016
- The Algorithmic Foundations of Differential Privacy2013
- On significance of the least significant bits for differential privacy2012