RETRACTED: Debiasing misinformation: how do people diagnose health recommendations from AI?
- 29 February 2024
- journal article
- research article
- Published by Emerald Publishing in Online Information Review
- Vol. 48 (5) , 1025-1044
Abstract
Purpose: This study examined how people assess health information from AI and improve their diagnostic ability to identify health misinformation. The proposed model was designed to test a cognitive heuristic theory in misinformation discernment. Design/methodology/approach: We proposed the heuristic-systematic model to assess health misinformation processing in the algorithmic context. Using the Analysis of Moment Structure (AMOS) 26 software, we tested fairness/transparency/accountability (FAccT) as constructs that influence the heuristic evaluation and systematic discernment of misinformation by users. To test moderating and mediating effects, PROCESS Macro Model 4 was used. Findings: The effect of AI-generated misinformation on people’s perceptions of the veracity of health information may differ according to whether they process misinformation heuristically or systematically. Heuristic processing is significantly associated with the diagnosticity of misinformation. There is a greater chance that misinformation will be correctly diagnosed and checked, if misinformation aligns with users’ heuristics or is validated by the diagnosticity they perceive. Research limitations/implications: When exposed to misinformation through algorithmic recommendations, users’ perceived diagnosticity of misinformation can be predicted accurately from their understanding of normative values. This perceived diagnosticity would then positively influence the accuracy and credibility of the misinformation. Practical implications: Perceived diagnosticity exerts a key role in fostering misinformation literacy, implying that improving people’s perceptions of misinformation and AI features is an efficient way to change their misinformation behavior. Social implications: Although there is broad agreement on the need to control and combat health misinformation, the magnitude of this problem remains unknown. It is essential to understand both users’ cognitive processes when it comes to identifying health misinformation and the diffusion mechanism from which such misinformation is framed and subsequently spread. Originality/value: The mechanisms through which users process and spread misinformation have remained open-ended questions. This study provides theoretical insights and relevant recommendations that can make users and firms/institutions alike more resilient in protecting themselves from the detrimental impact of misinformation. Peer review: The peer review history for this article is available at: https://publons.com/publon/10.1108/OIR-04-2023-0167Keywords
This publication has 36 references indexed in Scilit:
- A framework for understanding reasoning errors: From fake news to climate change and beyond2022
- Impact of perceived diagnosticity on live streams and consumer purchase intention: streamer type, product type, and brand awareness as moderatorsInformation Technology and Management, 2022
- When Does an Individual Accept Misinformation? An Extended Investigation Through Cognitive ModelingComputational Brain & Behavior, 2022
- How do people judge the credibility of algorithmic sources?AI & SOCIETY, 2021
- The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AIInternational Journal of Human-Computer Studies, 2021
- All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media MisinformationJournal of Experimental Political Science, 2020
- Explainable AI: from black box to glass boxJournal of the Academy of Marketing Science, 2019
- Exploring the effect of social media information quality, source credibility and reputation on informational fit-to-task: Moderating role of focused immersionComputers in Human Behavior, 2018
- Believe it or not: Factors influencing credibility on the WebJournal of the American Society for Information Science and Technology, 2001
- Heuristic versus systematic information processing and the use of source versus message cues in persuasion.Journal of Personality and Social Psychology, 1980