When negative media attitudes are overreported: comparing direct and list-experiment measures in Japan
Author:
Open Access
- 24 June 2026
- journal article
- Published by Oxford University Press (OUP) in International Journal of Public Opinion Research
- Vol. 38 (3)
Abstract
This research note tests whether direct questions (DQs) overestimate negative attitudes toward the news media in Japan relative to an indirect list experiment (LE). Two survey-embedded randomized experiments assigned respondents to either a DQ condition or a double-LE with two control sets. The focal statement was that “the mass media are harmful to society.” Across both studies, agreement was higher in the DQ condition than in the pooled LE estimate: 45.1% versus 29.7%, a 15.4-point gap. The double-list design showed no clear design effects, and the directional pattern was consistent across studies. These findings suggest that DQs may overstate negative media attitudes and highlight the directional nature of social desirability bias in surveys.Keywords
This publication has 15 references indexed in Scilit:
- Norms to be prejudiced: List experiments on attitudes towards immigrants in JapanSocial Science Research, 2022
- Anti-media expression by citizens: conservative summary sites, hostile media perceptions, and media trust in JapanInformation, Communication & Society, 2021
- News media trust and its impact on media use: toward a framework for future researchAnnals of the International Communication Association, 2020
- What Can We Learn with Statistical Truth Serum?Public Opinion Quarterly, 2013
- Statistical Analysis of List ExperimentsPolitical Analysis, 2012
- Determinants of social desirability bias in sensitive surveys: a literature reviewQuality & Quantity, 2011
- Sensitive questions in surveys.Psychological Bulletin, 2007
- Media Skepticism and Climate of Opinion PerceptionInternational Journal for Quality in Health Care, 2003
- Racial Attitudes and the "New South"The Journal of Politics, 1997
- The hostile media phenomenon: Biased perception and perceptions of media bias in coverage of the Beirut massacre.Journal of Personality and Social Psychology, 1985