"I inherently just trust that it works": Investigating Mental Models of Open-Source Libraries for Differential Privacy
Open Access
- 7 November 2024
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (CSCW2) , 1-39
Abstract
Differential privacy (DP) is a promising framework for privacy-preserving data science, but recent studies have exposed challenges in bringing this theoretical framework for privacy into practice. These tensions are particularly salient in the context of open-source software libraries for DP data analysis, which are emerging tools to help data stewards and analysts build privacy-preserving data pipelines for their applications. While there has been significant investment into such libraries, we need further inquiry into the role of these libraries in promoting understanding of and trust in DP, and in turn, the ways in which design of these open-source libraries can shed light on the challenges of creating trustworthy data infrastructures in practice. In this study, we use qualitative methods and mental models approaches to analyze the differences between conceptual models used to design open-source DP libraries and mental models of DP held by users. Through a two-stage study design involving formative interviews with 5 developers of open-source DP libraries and user studies with 17 data analysts, we find that DP libraries often struggle to bridge the gaps between developer and user mental models. In particular, we highlight the tension DP libraries face in maintaining rigorous DP implementations and facilitating user interaction. We conclude by offering practical recommendations for further development of DP libraries.Keywords
All Related Versions
Funding Information
- Alfred P. Sloan Foundation (G-2022-19501)
- National Science Foundation (TI-2303681)
This publication has 39 references indexed in Scilit:
- Investigating the Visual Utility of Differentially Private ScatterplotsIEEE Transactions on Visualization and Computer Graphics, 2023
- Differential Privacy for Government Agencies—Are We There Yet?Journal of the American Statistical Association, 2023
- Visualizing Dataflow Graphs of Deep Learning Models in TensorFlowIEEE Transactions on Visualization and Computer Graphics, 2017
- RAPPOR2014
- Trust and Distrust in Open Source Software DevelopmentJournal of Computer Information Systems, 2013
- No free lunch in data privacy2011
- Bridging the Gap in Computer Security Warnings: A Mental Model ApproachIEEE Security & Privacy, 2011
- Trust and vulnerability in open source softwareIEE Proceedings - Software, 2002
- Problem solving, cognition, and complex systems: Differences between experts and novicesComplexity, 2001
- Cognitive design elements to support the construction of a mental model during software explorationJournal of Systems and Software, 1999