What Can We Learn with Statistical Truth Serum?
Author:
- 24 January 2013
- journal article
- Published by Oxford University Press (OUP) in Public Opinion Quarterly
- Vol. 77 (S1) , 159-172
Abstract
Due to the inherent sensitivity of many survey questions, a number of researchers have adopted an indirect questioning technique known as the list experiment (or the item-count technique) in order to reduce dishonest or evasive responses. However, standard practice with the list experiment requires a large sample size, utilizes only a difference-in-means estimator, and does not provide a measure of the sensitive item for each respondent. This paper addresses all of these issues. First, the paper presents design principles for the standard list experiment (and the double list experiment) for the reduction of bias and variance as well as providing sample-size formulas for the planning of studies. Second, this paper proves that a respondent-level probabilistic measure for the sensitive item can be derived. This provides a basis for diagnostics, improved estimation, and regression analysis. The techniques in this paper are illustrated with a list experiment from the 2008–2009 American National Election Studies (ANES) Panel Study and an adaptation of this experiment.Keywords
This publication has 28 references indexed in Scilit:
- Measuring Social Desirability Effects on Self-Reported Turnout Using the Item Count TechniqueInternational Journal of Public Opinion Research, 2012
- Multivariate Regression Analysis for the Item Count TechniqueJournal of the American Statistical Association, 2011
- Race and 2008 Presidential Politics in Florida: A List ExperimentThe Forum, 2010
- Social desirability bias in voter turnout reports: Tests using the item count techniquePublic Opinion Quarterly, 2009
- Religion and Presidential Politics in Florida: A List Experiment*Social Science Quarterly, 2004
- A New Method of Examining Relationships between Individual Difference Measures and Sensitive Behavior Criteria: Evaluating the Unmatched Count TechniqueOrganizational Research Methods, 2004
- Affirmative Action and the Politics of RealignmentBritish Journal of Political Science, 1998
- Racial Attitudes and the "New South"The Journal of Politics, 1997
- Racial Prejudice and Attitudes Toward Affirmative ActionAmerican Journal of Political Science, 1997
- USING THE UNMATCHED COUNT TECHNIQUE (UCT) TO ESTIMATE BASE RATES FOR SENSITIVE BEHAVIORPersonnel Psychology, 1994