Social Media Authentication and Users’ Assessments of Health Information: Random Assignment Survey Experiment
Open Access
- 9 July 2024
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e52503
Abstract
Background: In an effort to signal the authenticity of user accounts, social networking sites (SNSs) such as Facebook and X, formerly known as Twitter, use visual heuristics (blue checkmarks) to signify whether accounts are verified. While these verification badges are generally well recognized (and often coveted) by SNS users, relatively little is known about how they affect users’ perceptions of accuracy or their likelihood of engaging with web-based information. This is particularly true in the case of information posted by medical experts and health care professionals. Objective: This study aims to use an experimental survey design to assess the effect of these verification badges on SNS users’ assessments of information accuracy as well as their proclivity to recirculate health information or follow verified medical experts in their social network. Methods: A survey experiment using random assignment was conducted on a representative sample of 534 adult SNS users in Florida, United States. A total of 2 separate experimental scenarios exposed users to vaccine-related posts from verified medical experts on X. In each case, the original post contained a platform-issued verification badge (treatment group), which was subsequently edited out of the image as an experimental control. For each scenario, respondents were randomly assigned to either the treatment or control group, and responses to 3 follow-up questions were assessed through a series of chi-square analyses and 2 logit regression models. Responses were fielded using a stratified quota sampling approach to ensure representativeness of the state’s population based on age, sex, race, ethnicity, and political affiliation. Results: Users’ assessments of information accuracy were not significantly impacted by the presence or absence of verification badges, and users exposed to the experimental treatment (verification badge) were not any more likely to repost the message or follow the author. While verification badges did not influence users’ assessments or subsequent behaviors, reliance on social media for health-related information and political affiliation were substantial predictors of accuracy assessments in both experimental scenarios. In scenario 1, which included a post addressing COVID-19 vaccine efficacy, users who relied on social media “a great deal” for health information were 2 times more likely to assess the post as accurate (odds ratio 2.033, 95% CI 1.129-3.661; P=.01). In scenario 2, which included a post about measles vaccines, registered Republicans were nearly 6 times less likely to assess the post as accurate (odds ratio 0.171, 95% CI 0.097-0.299; P<.001). Conclusions: For health professionals and medical experts wishing to leverage social networks to combat misinformation and spread reliable health-related content, account verification appears to offer little by way of added value. On the basis of prior research, other heuristics and communication strategies are likely to yield better results.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Excess Death Rates for Republican and Democratic Registered Voters in Florida and Ohio During the COVID-19 PandemicJAMA Internal Medicine, 2023
- When influencers are not very influential: The negative effects of social media verificationJournal of Consumer Behaviour, 2022
- Vaccine Hesitancy and Exposure to Misinformation: a Survey AnalysisJournal of General Internal Medicine, 2021
- Understanding the spread of COVID‐19 misinformation on social media: The effects of topics and a political leader's nudgeJournal of the Association for Information Science and Technology, 2021
- Perceptions and effects of COVID-19 related information in Denmark and Sweden – a web-based survey about COVID-19 and social mediaJournal of Public Health, 2021
- Hostile media bias on social media: Testing the effect of user comments on perceptions of news bias and credibilityHuman Behavior and Emerging Technologies, 2020
- Addressing Health-Related Misinformation on Social MediaJAMA, 2018
- Consumer health information on the Web: The relationship of visual design and perceptions of credibilityJournal of the American Society for Information Science and Technology, 2009
- Media Use and Political Predispositions: Revisiting the Concept of Selective ExposurePolitical Behavior, 2007
- The role of social categorization and perceived source credibility in minority influenceEuropean Journal of Social Psychology, 1988