Positive vs. Negative: The Impact of Question Polarity in Voting Advice Applications
Open Access
- 10 October 2016
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 11 (10) , e0164184
Abstract
Online Voting Advice Applications (VAAs) are survey-like instruments that help citizens to shape their political preferences and compare them with those of political parties. Especially in multi-party democracies, their increasing popularity indicates that VAAs play an important role in opinion formation for citizens, as well as in the public debate prior to elections. Hence, the objectivity and transparency of VAAs are crucial. In the design of VAAs, many choices have to be made. Extant research in survey methodology shows that the seemingly arbitrary choice to word questions positively (e.g., ‘The city council should allow cars into the city centre’) or negatively (‘The city council should ban cars from the city centre’) systematically affects the answers. This asymmetry in answers is in line with work on negativity bias in other areas of linguistics and psychology. Building on these findings, this study investigated whether question polarity also affects the answers to VAA statements. In a field experiment (N = 31,112) during the Dutch municipal elections we analysed the effects of polarity for 16 out of 30 VAA statements with a large variety of linguistic contrasts. Analyses show a significant effect of question wording for questions containing a wide range of implicit negations (such as ‘forbid’ vs. ‘allow’), as well as for questions with explicit negations (e.g., ‘not’). These effects of question polarity are found especially for VAA users with lower levels of political sophistication. As these citizens are an important target group for Voting Advice Applications, this stresses the need for VAA builders to be sensitive to wording choices when designing VAAs. This study is the first to show such consistent wording effects not only for political attitude questions with implicit negations in VAAs, but also for political questions containing explicit negations.Keywords
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (321-89-003.)
This publication has 35 references indexed in Scilit:
- Do voters follow the recommendations of voter advice application websites? A study of the effects of kieskompas.nl on its users’ vote choices in the 2010 Dutch legislative electionsParty Politics, 2012
- Agree or Disagree? Cognitive Processes in Answering Contrastive Survey QuestionsDiscourse Processes, 2011
- Examples of mixed-effects modeling with crossed random effects and with binomial dataJournal of Memory and Language, 2008
- Public Opinion, Political Communication and the InternetPolitics, 2002
- Wording Effects in Survey Research Using Meta-Analysis to Explain the Forbid/Allow AsymmetryJournal of Quantitative Linguistics, 1999
- Political Sophistication and Models of Issue VotingBritish Journal of Political Science, 1995
- Response strategies for coping with the cognitive demands of attitude measures in surveysApplied Cognitive Psychology, 1991
- Communication and Persuasion: Central and Peripheral Routes to Attitude ChangeThe American Journal of Psychology, 1988
- Not Forbidding Isn't Allowing: The Cognitive Basis of the Forbid-Allow AsymmetryPublic Opinion Quarterly, 1986
- Experiments in Wording Questions: IIPublic Opinion Quarterly, 1941