Proving Differential Privacy in Hoare Logic
Authors:
- Gilles BartheGBGilles Barthe
- Marco GaboardiMGMarco Gaboardi
- Emilio Jesus Gallego AriasEAEmilio Jesus Gallego Arias
- Justin HsuJHJustin Hsu
- Cesar KunzCKCesar Kunz
- Pierre-Yves StrubPSPierre-Yves Strub
Open Access
- 1 July 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636900,p. 411-424
Abstract
Differential privacy is a rigorous, worst-case notion of privacy-preserving computation. Informally, a probabilistic program is differentially private if the participation of a single individual in the input database has a limited effect on the program's distribution on outputs. More technically, differential privacy is a quantitative 2-safety property that bounds the distance between the output distributions of a probabilistic program on adjacent inputs. Like many 2-safety properties, differential privacy lies outside the scope of traditional verification techniques. Existing approaches to enforce privacy are based on intricate, non-conventional type systems, or customized relational logics. These approaches are difficult to implement and often cumbersome to use. We present an alternative approach that verifies differential privacy by standard, non-relational reasoning on non-probabilistic programs. Our approach transforms a probabilistic program into a non-probabilistic program which simulates two executions of the original program. We prove that if the target program is correct with respect to a Hoare specification, then the original probabilistic program is differentially private. We provide a variety of examples from the differential privacy literature to demonstrate the utility of our approach. Finally, we compare our approach with existing verification techniques for privacy.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Probabilistic Relational Reasoning for Differential PrivacyACM Transactions on Programming Languages and Systems, 2013
- Beyond 2-Safety: Asymmetric Product Programs for Relational Program Verification2013
- Incremental Hyperproperty Model Checking via GamesLecture Notes in Computer Science, 2013
- Formal Verification of Differential Privacy for Interactive Systems (Extended Abstract)Electronic Notes in Theoretical Computer Science, 2011
- Computer-Aided Security Proofs for the Working Cryptographer2011
- Relational Verification Using Product Programs2011
- Differentially Private Combinatorial Optimization2010
- CoVaC: Compiler Validation by Program Analysis of the Cross-Product2008
- Differential Privacy: A Survey of Results2008
- A Theorem Proving Approach to Analysis of Secure Information Flow2005