Evaluating the Health Impact of Large-Scale Public Policy Changes: Classical and Novel Approaches
Open Access
- 20 March 2017
- journal article
- review article
- Published by Annual Reviews in Annual Review of Public Health
- Vol. 38 (1) , 351-370
Abstract
Large-scale public policy changes are often recommended to improve public health. Despite varying widely—from tobacco taxes to poverty-relief programs—such policies present a common dilemma to public health researchers: how to evaluate their health effects when randomized controlled trials are not possible. Here, we review the state of knowledge and experience of public health researchers who rigorously evaluate the health consequences of large-scale public policy changes. We organize our discussion by detailing approaches to address three common challenges of conducting policy evaluations: distinguishing a policy effect from time trends in health outcomes or preexisting differences between policy-affected and -unaffected communities (using difference-in-differences approaches); constructing a comparison population when a policy affects a population for whom a well-matched comparator is not immediately available (using propensity score or synthetic control approaches); and addressing unobserved confounders by utilizing quasi-random variations in policy exposure (using regression discontinuity, instrumental variables, or near-far matching approaches).Keywords
This publication has 75 references indexed in Scilit:
- Evaluation of public health professionals’ capacity to implement environmental changes supportive of healthy weightEvaluation and Program Planning, 2012
- Bribery or just desserts? Evidence on the influence of Congressional reproductive policy voting patterns on PAC contributions from exogenous variation in the sex mix of legislator offspringSocial Science Research, 2012
- An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational StudiesMultivariate Behavioral Research, 2011
- The Relative Ability of Different Propensity Score Methods to Balance Measured Covariates Between Treated and Untreated Subjects in Observational StudiesMedical Decision Making, 2009
- Revisiting Robinson: The perils of individualistic and ecologic fallacyInternational Journal of Epidemiology, 2009
- Type I Error Rates, Coverage of Confidence Intervals, and Variance Estimation in Propensity-Score Matched AnalysesThe International Journal of Biostatistics, 2009
- Do State Parity Laws Reduce the Financial Burden on Families of Children with Mental Health Care Needs?Health Services Research, 2006
- The Effects of Universal Pre-K on Cognitive Development.Developmental Psychology, 2005
- Effects of Medicare Payment Changes on Nursing Home Staffing and DeficienciesHealth Services Research, 2004
- How Much Should We Trust Differences-In-Differences Estimates?The Quarterly Journal of Economics, 2004