Sensitivity analysis of the unconfoundedness assumption with an application to an evaluation of college choice effects on earnings
Authors:
- 17 February 2014
- journal article
- research article
- Published by Taylor & Francis in Journal of Applied Statistics
- Vol. 41 (8) , 1767-1784
Abstract
We evaluate the effects of college choice on earnings using Swedish register databases. This case study is used to motivate the introduction of a novel procedure to analyse the sensitivity of such an observational study to the assumption made that there are no unobserved confounders – variables affecting both college choice and earnings. This assumption is not testable without further information, and should be considered an approximation of reality. To perform a sensitivity analysis, we measure the departure from the unconfoundedness assumption with the correlation between college choice and earnings when conditioning on observed covariates. The use of a correlation as a measure of dependence allows us to propose a standardised procedure by advocating the use of a fixed value for the correlation, typically 1% or 5%, when checking the sensitivity of an evaluation study. A correlation coefficient is, moreover, intuitive to most empirical scientists, which makes the results of our sensitivity analysis easier to communicate than those of previously proposed methods. In our evaluation of the effects of college choice on earnings, the significantly positive effect obtained could not be questioned by a sensitivity analysis allowing for unobserved confounders inducing at most 5% correlation between college choice and earnings.Keywords
This publication has 26 references indexed in Scilit:
- Changes in the returns to education and college qualityEconomics of Education Review, 2010
- The Effect of Attending the Flagship State University on Earnings: A Discontinuity-Based ApproachReview of Economics and Statistics, 2009
- From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?Journal of Applied Econometrics, 2008
- College Choice and Subsequent Earnings: Results Using Swedish Sibling Data*The Scandinavian Journal of Economics, 2005
- Local Model Uncertainty and Incomplete-Data Bias (With Discussion)Journal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- How robust is the evidence on the effects of college quality? Evidence from matchingJournal of Econometrics, 2004
- Counterfactual Models of Neighborhood Effects: The Effect of Neighborhood Poverty on Dropping Out and Teenage PregnancyAmerican Journal of Sociology, 2003
- Local Sensitivity Approximations for Selectivity BiasJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- Sample Selection Bias as a Specification ErrorEconometrica, 1979