Providing Access to Confidential Research Data Through Synthesis and Verification: An Application to Data on Employees of the U.S. Federal Government
Authors:
Preprint
Abstract
Data stewards seeking to provide access to large-scale social science data face a difficult challenge. They have to share data in ways that protect privacy and confidentiality, are informative for many analyses and purposes, and are relatively straightforward to use by data analysts. One approach suggested in the literature is that data stewards generate and release synthetic data, i.e., data simulated from statistical models, while also providing users access to a verification server that allows them to assess the quality of inferences from the synthetic data. We present an application of the synthetic data plus verification server approach to longitudinal data on employees of the U.S. federal government. As part of the application, we present a novel model for generating synthetic career trajectories, as well as strategies for generating high dimensional, longitudinal synthetic datasets. We also present novel verification algorithms for regression coefficients that satisfy differential privacy. We illustrate the integrated use of synthetic data plus verification via analysis of differentials in pay by race. The integrated system performs as intended, allowing users to explore the synthetic data for potential pay differentials and learn through verifications which findings in the synthetic data hold up and which do not. The analysis on the confidential data reveals pay differentials across races not documented in published studies.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Synthetic Datasets for Statistical Disclosure Control2011
- Verification servers: Enabling analysts to assess the quality of inferences from public use dataComputational Statistics & Data Analysis, 2009
- A new approach for disclosure control in the IAB establishment panel—multiple imputation for a better data accessAStA Advances in Statistical Analysis, 2008
- Choosing Public Sector Employment: The Impact of Wages on the Representation of Women and Minorities in State BureaucraciesJournal of Public Administration Research and Theory, 2007
- Releasing Multiply Imputed, Synthetic Public use Microdata: An Illustration and Empirical StudyJournal of the Royal Statistical Society Series A: Statistics in Society, 2004
- Are Black and White Income Distributions Converging? Time Series AnalysisThe Review of Black Political Economy, 2002
- Chapter 48 Race and gender in the labor market1999
- Weaving Technology and Policy Together to Maintain ConfidentialityJournal of Law, Medicine & Ethics, 1997
- The Politics of Employment Discrimination in the Federal BureaucracyThe Journal of Law and Economics, 1982
- Wage Determination in the Federal Government: The Role of Constituents and BureaucratsJournal of Political Economy, 1980