Assessing the Correspondence between Experimental Results Obtained in the Lab and Field: A Review of Recent Social Science Research
- 4 August 2014
- journal article
- review article
- Published by Cambridge University Press (CUP) in Political Science Research and Methods
- Vol. 3 (1) , 113-131
Abstract
A small but growing social science literature examines the correspondence between experimental results obtained in lab and field settings. This article reviews this literature and reanalyzes a set of recent experiments carried out in parallel in both the lab and field. Using a standardized format that calls attention to both the experimental estimates and the statistical uncertainty surrounding them, the study analyzes the overall pattern of lab-field correspondence, which is found to be quite strong (Spearman'sρ= 0.73). Recognizing that this correlation may be distorted by the ad hoc manner in which lab-field comparisons are constructed (as well as the selective manner in which results are reported and published), the article concludes by suggesting directions for future research, stressing in particular the need for more systematic investigation of treatment effect heterogeneity.Keywords
This publication has 45 references indexed in Scilit:
- Identity Congruency Effects on DonationsJournal of Marketing Research, 2008
- Using normative social influence to promote conservation among hotel guestsSocial Influence, 2008
- Social Pressure and Voter Turnout: Evidence from a Large-Scale Field ExperimentAmerican Political Science Review, 2008
- Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field ExperimentsEconometrica, 2006
- Cultural Differences in Ultimatum Game Experiments: Evidence from a Meta-AnalysisExperimental Economics, 2004
- The Inefficiency of Splitting the BillThe Economic Journal, 2004
- Performance in Competitive Environments: Gender DifferencesThe Quarterly Journal of Economics, 2003
- Pay Enough or Don't Pay at All*The Quarterly Journal of Economics, 2000
- College sophomores in the laboratory: Influences of a narrow data base on social psychology's view of human nature.Journal of Personality and Social Psychology, 1986
- The file drawer problem and tolerance for null results.Psychological Bulletin, 1979