DDUO: General-Purpose Dynamic Analysis for Differential Privacy
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-15
Abstract
Differential privacy enables general statistical analysis of data with formal guarantees of privacy protection at the individual level. Tools that assist data analysts with utilizing differential privacy have frequently taken the form of programming languages and libraries. However, many existing programming languages designed for compositional verification of differential privacy impose significant burden on the programmer (in the form of complex type annotations). Supplementary library support for privacy analysis built on top of existing general-purpose languages has been more usable, but incapable of pervasive end-to-end enforcement of sensitivity analysis and privacy composition. We introduce DDuo, a dynamic analysis for enforcing differential privacy. DDuo is usable by non-experts: its analysis is automatic and it requires no additional type annotations. DDuo can be implemented as a library for existing programming languages; we present a reference implementation in Python which features moderate runtime overheads on realistic workloads. We include support for several data types, distance metrics and operations which are commonly used in modern machine learning programs. We also provide initial support for tracking the sensitivity of data transformations in popular Python libraries for data analysis. We formalize the novel core of the DDuo system and prove it sound for sensitivity analysis via a logical relation for metric preservation. We also illustrate DDuo's usability and flexibility through various case studies which implement state-of-the-art machine learning algorithms.Keywords
All Related Versions
Funding Information
- National Science Foundation
This publication has 39 references indexed in Scilit:
- LightDP: towards automating differential privacy proofs2017
- Proving Differential Privacy via Probabilistic Couplings2016
- Noninterference for freeACM SIGPLAN Notices, 2015
- RAPPOR2014
- Differentially Private Naive Bayes Classification2013
- Probabilistic Relational Reasoning for Differential PrivacyACM Transactions on Programming Languages and Systems, 2013
- Privacy integrated queries2009
- Step-Indexed Syntactic Logical Relations for Recursive and Quantified Types2006
- A core calculus of dependency1999
- A Per Model of Secure Information Flow in Sequential Programs1999