Probabilistic Relational Reasoning for Differential Privacy
Open Access
- 1 November 2013
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Programming Languages and Systems
- Vol. 35 (3) , 1-49
Abstract
Differential privacy is a notion of confidentiality that allows useful computations on sensible data while protecting the privacy of individuals. Proving differential privacy is a difficult and error-prone task that calls for principled approaches and tool support. Approaches based on linear types and static analysis have recently emerged; however, an increasing number of programs achieve privacy using techniques that fall out of their scope. Examples include programs that aim for weaker, approximate differential privacy guarantees and programs that achieve differential privacy without using any standard mechanisms. Providing support for reasoning about the privacy of such programs has been an open problem. We report on CertiPriv, a machine-checked framework for reasoning about differential privacy built on top of the Coq proof assistant. The central component of CertiPriv is a quantitative extension of probabilistic relational Hoare logic that enables one to derive differential privacy guarantees for programs from first principles. We demonstrate the applicability of CertiPriv on a number of examples whose formal analysis is out of the reach of previous techniques. In particular, we provide the first machine-checked proofs of correctness of the Laplacian, Gaussian, and exponential mechanisms and of the privacy of randomized and streaming algorithms from the literature.Keywords
Funding Information
- Spanish project (TIN2009-14599 DESAFIOS 10)
- Seventh Framework Programme (FP7-256980 NESSoS, FP7-229599 AMAROUT)
- French project (ANR SESUR-012 SCALP)
- Madrid Regional project (S2009TIC-1465 PROMETIDOS)
This publication has 41 references indexed in Scilit:
- Beyond Differential Privacy: Composition Theorems and Relational Logic for f-divergences between Probabilistic Programs2013
- Formal Verification of Differential Privacy for Interactive Systems (Extended Abstract)Electronic Notes in Theoretical Computer Science, 2011
- A firm foundation for private data analysisCommunications of the ACM, 2011
- Computational Differential Privacy2009
- Probabilistic guarded commands mechanized in HOLTheoretical Computer Science, 2005
- Secure Information Flow as a Safety Problem2005
- Probabilistic Extensions of Process Algebras**This chapter is dedicated to the fond memory of Linda Christoff.2001
- Probabilistic predicate transformersACM Transactions on Programming Languages and Systems, 1996
- A probabilistic PDLJournal of Computer and System Sciences, 1985
- A probabilistic dynamic logicJournal of Computer and System Sciences, 1984