The emotional effects of multimodal disinformation: How multimodality, issue relevance, and anxiety affect misperceptions about the flu vaccine
- 11 April 2023
- journal article
- research article
- Published by SAGE Publications in New Media & Society
- Vol. 26 (12) , 6838-6860
Abstract
Disinformation presented in multiple modalities (textual, visual, and auditory modes; multimodal disinformation) has become a serious concern. This study examines how disinformation, portrayed using an image or video format, may be more powerful than text-only disinformation. In particular, we examined the impact on affective mechanisms, as well as the moderating role of perceived issue relevance. Through an online experiment with modality conditions and a control group (text-only disinformation vs image-plus-text disinformation vs video-plus-text disinformation vs control; N = 413), results indicate that while anxiety is a critical mechanism that explains the overall effects of disinformation on misperceptions, video-plus-text disinformation turns out to increase misperceptions directly or indirectly through anxiety. Video-plus-text disinformation (vs control) showed a significant interaction with perceived issue relevance; that said, the difference in anxiety decreased between those with low and high perceived issue relevance in the video-plus-text disinformation. Implications are discussed in light of the realism heuristic, affect heuristic, and modality-biased processing in explaining the emotional impact of multimodal disinformation.Keywords
Funding Information
- Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (NRF-2021S1A5C2A02088387)
This publication has 53 references indexed in Scilit:
- If a picture is worth a thousand words is video worth a million? Differences in affective and cognitive processing of video and text casesJournal of Computing in Higher Education, 2011
- Social and Heuristic Approaches to Credibility Evaluation OnlineJournal of Communication, 2010
- The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same ConstructsJournal of Marketing Research, 2007
- The affect heuristicEuropean Journal of Operational Research, 2007
- Message Properties, Mediating States, and Manipulation Checks: Claims, Evidence, and Data Analysis in Experimental Persuasive Message Effects ResearchCommunication Theory, 2003
- The Limited Capacity Model of Mediated Message ProcessingJournal of Communication, 2000
- Framing: Toward Clarification of a Fractured ParadigmJournal of Communication, 1993
- Patterns of appraisal and emotion related to taking an exam.Journal of Personality and Social Psychology, 1987
- The Elaboration Likelihood Model of Persuasion1986
- Issue involvement can increase or decrease persuasion by enhancing message-relevant cognitive responses.Journal of Personality and Social Psychology, 1979