Innovations in Experimental Design in Attitude Surveys
Authors:
- 1 August 1996
- journal article
- Published by Annual Reviews in Annual Review of Sociology
- Vol. 22 (1) , 377-399
Abstract
In the last decade a revolution has occurred in the design of public opinion surveys. The principal breakthrough has been to combine the distinctive external validity advantages of the representative public opinion survey with the decisive internal validity strengths of the fully randomized, multifaceted experiment. The availability of computer-driven multifactorial, multivalent designs has encouraged a reorientation from narrowly methodological concerns to broader substantive issues. After a season in which the principal emphasis in survey-based experimentation was on standardization of measurement and methodological refinements, the emphasis now is on substantive discoveries and on innovation—new technology, new procedures, and new objectives. In this chapter, we survey the integration of experimental design and large-scale, representative, general population samples. After highlighting the limitations of the classic split-ballot experiment, we distinguish between nondirective and directive experimental variations, and, among the directive, between postdecisional and predecisional. We introduce a tripartite analytical scheme, sorting experimental variations as a function of whether they manipulate (i) the formulation of a choice, (ii) the context of choice, or (iii) the characteristics of the chooser. Finally we give an account of the experimental style now characteristic of general population attitude surveys, underlining its low emotional intensity and low cognitive demands, attributing both to features of (i) the interview site, (ii) the sample, (iii) the mode of interviewing, and (iv) considerations of ethics.Keywords
This publication has 62 references indexed in Scilit:
- Racial Prejudice and Attitudes Toward Affirmative ActionAmerican Journal of Political Science, 1997
- Black Candidates, White Voters: Understanding Racial Bias in Political PerceptionsAmerican Journal of Political Science, 1995
- When White Voters Evaluate Black Candidates: The Processing Implications of Candidate Skin Color, Prejudice, and Self-MonitoringAmerican Journal of Political Science, 1993
- Response-Time Measurement in Survey Research A Method for Cati and a New Look at NonattitudesPublic Opinion Quarterly, 1991
- Mimicking Political Debate with Survey Questions: The Case of White Opinion on Affirmative Action for BlacksSocial Cognition, 1990
- Response Effects in Mail SurveysPublic Opinion Quarterly, 1990
- Contrasting Rational and Psychological Analyses of Political ChoiceAmerican Political Science Review, 1988
- Experiments With the Middle Response Alternative in Survey QuestionsPublic Opinion Quarterly, 1987
- Not Forbidding Isn't Allowing: The Cognitive Basis of the Forbid-Allow AsymmetryPublic Opinion Quarterly, 1986
- The Perceived Threat of Nuclear War, Salience, and Open QuestionsPublic Opinion Quarterly, 1986