Evaluating Twitter’s algorithmic amplification of low-credibility content: an observational study
Author:
Open Access
- 7 March 2024
- journal article
- research article
- Published by Springer Nature in EPJ Data Science
- Vol. 13 (1) , 1-15
Abstract
Artificial intelligence (AI)-powered recommender systems play a crucial role in determining the content that users are exposed to on social media platforms. However, the behavioural patterns of these systems are often opaque, complicating the evaluation of their impact on the dissemination and consumption of disinformation and misinformation. To begin addressing this evidence gap, this study presents a measurement approach that uses observed digital traces to infer the status of algorithmic amplification of low-credibility content on Twitter over a 14-day period in January 2023. Using an original dataset of ≈ 2.7 million posts on COVID-19 and climate change published on the platform, this study identifies tweets sharing information from low-credibility domains, and uses a bootstrapping model with two stratifications, a tweet’s engagement level and a user’s followers level, to compare any differences in impressions generated between low-credibility and high-credibility samples. Additional stratification variables of toxicity, political bias, and verified status are also examined. This analysis provides valuable observational evidence on whether the Twitter algorithm favours the visibility of low-credibility content, with results indicating that, on aggregate, tweets containing low-credibility URL domains perform better than tweets that do not across both datasets. However, this effect is largely attributable to a difference in high-engagement, high-followers tweets, which are very impactful in terms of impressions generation, and are more likely receive amplified visibility when containing low-credibility content. Furthermore, high toxicity tweets and those with right-leaning bias see heightened amplification, as do low-credibility tweets from verified accounts. Ultimately, this suggests that Twitter’s recommender system may have facilitated the diffusion of false content by amplifying the visibility of low-credibility content with high-engagement generated by very influential users.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- ChatGPT outperforms crowd workers for text-annotation tasksProceedings of the National Academy of Sciences, 2023
- Growing polarization around climate change on social mediaNature Climate Change, 2022
- Link recommendation algorithms and dynamics of polarization in online social networksProceedings of the National Academy of Sciences, 2021
- The echo chamber effect on social mediaProceedings of the National Academy of Sciences, 2021
- How Algorithms Create and Prevent Fake News2021
- Recommending what video to watch next2019
- Influence of fake news in Twitter during the 2016 US presidential electionNature Communications, 2019
- Social Media Recommender Systems: Review and Open Research IssuesIEEE Access, 2018
- Emotion shapes the diffusion of moralized content in social networksProceedings of the National Academy of Sciences, 2017
- From “information” to “knowing”: Exploring the role of social media in contemporary news consumptionComputers in Human Behavior, 2014