Providing access to confidential research data through synthesis and verification: An application to data on employees of the U.S. federal government
Authors:
- Andrés F. BarrientosABAndrés F. Barrientos
- Alexander BoltonABAlexander Bolton
- Tom BalmatTBTom Balmat
- Jerome P. ReiterJRJerome P. Reiter
- John M. de FigueiredoJFJohn M. de Figueiredo
- Ashwin MachanavajjhalaAMAshwin Machanavajjhala
- Yan ChenYCYan Chen
- Charley KneifelCKCharley Kneifel
- Mark DeLongMDMark DeLong
- 1 June 2018
- journal article
- research article
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 12 (2) , 1124-1156
Abstract
Data stewards seeking to provide access to large-scale social science data face a difficult challenge. They have to share data in ways that protect privacy and confidentiality, are informative for many analyses and purposes, and are relatively straightforward to use by data analysts. One approach suggested in the literature is that data stewards generate and release synthetic data, that is, data simulated from statistical models, while also providing users access to a verification server that allows them to assess the quality of inferences from the synthetic data. We present an application of the synthetic data plus verification server approach to longitudinal data on employees of the U.S. federal government. As part of the application, we present a novel model for generating synthetic career trajectories, as well as strategies for generating high dimensional, longitudinal synthetic datasets. We also present novel verification algorithms for regression coefficients that satisfy differential privacy. We illustrate the integrated use of synthetic data plus verification via analysis of differentials in pay by race. The integrated system performs as intended, allowing users to explore the synthetic data for potential pay differentials and learn through verifications which findings in the synthetic data hold up and which do not. The analysis on the confidential data reveals pay differentials across races not documented in published studies.Keywords
All Related Versions
This publication has 53 references indexed in Scilit:
- Towards Unrestricted Public Use Business Microdata: The Synthetic Longitudinal Business DatabaseInternational Statistical Review, 2011
- Bayesian Multiscale Multiple Imputation With Implications for Data ConfidentialityJournal of the American Statistical Association, 2010
- A new approach for disclosure control in the IAB establishment panel—multiple imputation for a better data accessAStA Advances in Statistical Analysis, 2008
- The Multiple Adaptations of Multiple ImputationJournal of the American Statistical Association, 2007
- Secure, Privacy-Preserving Analysis of Distributed DatabasesTechnometrics, 2007
- Choosing Public Sector Employment: The Impact of Wages on the Representation of Women and Minorities in State BureaucraciesJournal of Public Administration Research and Theory, 2007
- Continuing Progress Toward Racial and Gender Pay Equality in the Federal ServiceReview of Public Personnel Administration, 1998
- Will Locality Pay Solve Recruitment and Retention Problems in the Federal Civil Service?Public Administration Review, 1995
- The Politics of Employment Discrimination in the Federal BureaucracyThe Journal of Law and Economics, 1982
- Wage Determination in the Federal Government: The Role of Constituents and BureaucratsJournal of Political Economy, 1980