Jennifer Nancy Lee Allen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jennifer Nancy Lee Allen has a total of 45 co-authors. Here are the top co-authors by number of shared publications:
- David Gertler Rand
Massachusetts Institute of Technology
10 shared publications - Gordon Pennycook
Department of Psychology, Cornell University
6 shared publications - Cameron Martel
Affiliation Sloan School of Management, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
4 shared publications - Antonio Alonso Arechar
Center for Research and Teaching in Economics (CIDE), Aguascalientes, Mexico
3 shared publications - Duncan J. Watts
Department of Computer and Information Science, University of Pennsylvania, Philadelphia, USA
2 shared publications - Adam J. Berinsky
Massachusetts Institute of Technology
1 shared publication
Latest Publications
- Open Access
- 6 June 2026
- Published by Center for Open Science in PsyArXiv
Assessing the efficacy of crowdsourced fact-checking for TikTok videos
Social media companies are increasingly shifting towards crowdsourced fact-checking approaches, which are more scalable than solely relying on professional fact-checkers. While past work suggests these approaches are effective for news headlines, it is unclear whether they are effective for short-form video content like TikToks, which are increasingly prevalent as a source of news/information. We compare the accuracy ratings of three professional fact-checkers to those of layperson crowds on three politicized topics: the Ukraine/Russia conflict, climate change, and abortion. Professional fact-checkers showed reasonable agreement on TikToks about the Ukraine/Russia conflict and abortion, but poor agreement on TikToks about climate change. Poorer performance by Republican laypeople meant that politically-balanced crowds performed as well as professional fact-checkers on Ukraine/Russia TikToks, while only Democrat-only crowds performed as well as professionals on abortion TikToks. A classifier using layperson ratings to predict professionals’ ratings performed well on TikToks where professionals’ ratings were unanimous, suggesting that crowdsourcing may be effective for unambiguously true or false TikToks.
- 6 June 2026
- Published by Center for Open Science in PsyArXiv
Open AccessAssessing the efficacy of crowdsourced fact-checking for TikTok videos
Social media companies are increasingly shifting towards crowdsourced fact-checking approaches, which are more scalable than solely relying on professional fact-checkers. While past work suggests these approaches are effective for news headlines, it is unclear whether they are effective for short-form video content like TikToks, which are increasingly prevalent as a source of news/information. We compare the accuracy ratings of three professional fact-checkers to those of layperson crowds on three politicized topics: the Ukraine/Russia conflict, climate change, and abortion. Professional fact-checkers showed reasonable agreement on TikToks about the Ukraine/Russia conflict and abortion, but poor agreement on TikToks about climate change. Poorer performance by Republican laypeople meant that politically-balanced crowds performed as well as professional fact-checkers on Ukraine/Russia TikToks, while only Democrat-only crowds performed as well as professionals on abortion TikToks. A classifier using layperson ratings to predict professionals’ ratings performed well on TikToks where professionals’ ratings were unanimous, suggesting that crowdsourcing may be effective for unambiguously true or false TikToks.
- Open Access
- 10 December 2025
- Published by Center for Open Science in PsyArXiv
Political motives help rather than hinder crowdsourced fact-checking
Social media platforms are adopting crowd-based strategies for identifying false or misleading content. However, existing theories suggest laypeople can be politically biased, and these political motives undermine accuracy. Alternatively, we propose that political and accuracy motives operate separately, and show theoretically that this implies that more politically motivated individuals may often be more accurate. We empirically assess this proposal using a survey study and field data from X’s Community Notes. As predicted, politically discordant false posts are flagged most often, and more politically motivated users flag more posts while exhibiting equal or higher flagging discernment (along with more political bias). These users also provision high-quality ratings without undermining system-level outcomes. Politically motivated individuals are integral to provisioning a high quantity and quality of crowdsourced fact-checks.
- 10 December 2025
- Published by Center for Open Science in PsyArXiv
Open AccessPolitical motives help rather than hinder crowdsourced fact-checking
Social media platforms are adopting crowd-based strategies for identifying false or misleading content. However, existing theories suggest laypeople can be politically biased, and these political motives undermine accuracy. Alternatively, we propose that political and accuracy motives operate separately, and show theoretically that this implies that more politically motivated individuals may often be more accurate. We empirically assess this proposal using a survey study and field data from X’s Community Notes. As predicted, politically discordant false posts are flagged most often, and more politically motivated users flag more posts while exhibiting equal or higher flagging discernment (along with more political bias). These users also provision high-quality ratings without undermining system-level outcomes. Politically motivated individuals are integral to provisioning a high quantity and quality of crowdsourced fact-checks.
- Open Access
- 16 September 2025
- Published by Center for Open Science in PsyArXiv
Divergent patterns of engagement with partisan and low-quality news across seven social media platforms
In recent years, social media has become increasingly fragmented, as platforms evolve and new alternatives emerge. Yet most research studies a single platform—typically Twitter/X, or occasionally Facebook—leaving little known about the broader social media landscape. Here we shed new light on patterns of cross-platform variation in the high-stakes context of news sharing. We examine the relationship between user engagement and news domains’ political orientation and quality across seven platforms: Twitter/X, BlueSky, TruthSocial, Gab, GETTR, Mastodon, and LinkedIn. Using an exhaustive sampling strategy, we analyze all (over 10 million) posts containing links to news domains shared on these platforms during January 2024. We find that the news shared on platforms with more conservative user bases is significantly lower quality on average. Turning to patterns of engagement, we find—contrary to hypotheses of a consistent “right wing advantage” on social media—that the relationship between political lean and engagement is strongly heterogeneous across platforms. Conservative new posts receive more engagement on platforms where most content is conservative, and vice versa for liberal news posts, consistent with an “echo platform” perspective. In contrast, the relationship between news quality and engagement is strikingly consistent: across all platforms examined, lower-quality news posts received higher average engagement even though higher quality news is substantially more prevalent and garners far more total engagement across posts. This pattern holds despite accounting for poster-level variation, and is observed even in the absence of ranking algorithms, suggesting user preferences – not algorithmic – bias may underlie the underperformance of higher-quality news.
- 16 September 2025
- Published by Center for Open Science in PsyArXiv
Open AccessDivergent patterns of engagement with partisan and low-quality news across seven social media platforms
In recent years, social media has become increasingly fragmented, as platforms evolve and new alternatives emerge. Yet most research studies a single platform—typically Twitter/X, or occasionally Facebook—leaving little known about the broader social media landscape. Here we shed new light on patterns of cross-platform variation in the high-stakes context of news sharing. We examine the relationship between user engagement and news domains’ political orientation and quality across seven platforms: Twitter/X, BlueSky, TruthSocial, Gab, GETTR, Mastodon, and LinkedIn. Using an exhaustive sampling strategy, we analyze all (over 10 million) posts containing links to news domains shared on these platforms during January 2024. We find that the news shared on platforms with more conservative user bases is significantly lower quality on average. Turning to patterns of engagement, we find—contrary to hypotheses of a consistent “right wing advantage” on social media—that the relationship between political lean and engagement is strongly heterogeneous across platforms. Conservative new posts receive more engagement on platforms where most content is conservative, and vice versa for liberal news posts, consistent with an “echo platform” perspective. In contrast, the relationship between news quality and engagement is strikingly consistent: across all platforms examined, lower-quality news posts received higher average engagement even though higher quality news is substantially more prevalent and garners far more total engagement across posts. This pattern holds despite accounting for poster-level variation, and is observed even in the absence of ranking algorithms, suggesting user preferences – not algorithmic – bias may underlie the underperformance of higher-quality news.
- Top Cited Papers
- 31 May 2024
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 384 (6699) , eadk3451
Quantifying the impact of misinformation and vaccine-skeptical content on Facebook
Low uptake of the COVID-19 vaccine in the US has been widely attributed to social media misinformation. To evaluate this claim, we introduce a framework combining lab experiments (totalN= 18,725), crowdsourcing, and machine learning to estimate the causal effect of 13,206 vaccine-related URLs on the vaccination intentions of US Facebook users (N≈ 233 million). We estimate that the impact of unflagged content that nonetheless encouraged vaccine skepticism was 46-fold greater than that of misinformation flagged by fact-checkers. Although misinformation reduced predicted vaccination intentions significantly more than unflagged vaccine content when viewed, Facebook users’ exposure to flagged content was limited. In contrast, unflagged stories highlighting rare deaths after vaccination were among Facebook’s most-viewed stories. Our work emphasizes the need to scrutinize factually accurate but potentially misleading content in addition to outright falsehoods.
- 31 May 2024
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 384 (6699) , eadk3451
Top Cited PapersQuantifying the impact of misinformation and vaccine-skeptical content on Facebook
Low uptake of the COVID-19 vaccine in the US has been widely attributed to social media misinformation. To evaluate this claim, we introduce a framework combining lab experiments (totalN= 18,725), crowdsourcing, and machine learning to estimate the causal effect of 13,206 vaccine-related URLs on the vaccination intentions of US Facebook users (N≈ 233 million). We estimate that the impact of unflagged content that nonetheless encouraged vaccine skepticism was 46-fold greater than that of misinformation flagged by fact-checkers. Although misinformation reduced predicted vaccination intentions significantly more than unflagged vaccine content when viewed, Facebook users’ exposure to flagged content was limited. In contrast, unflagged stories highlighting rare deaths after vaccination were among Facebook’s most-viewed stories. Our work emphasizes the need to scrutinize factually accurate but potentially misleading content in addition to outright falsehoods.
- 7 October 2023
- Published by Taylor & Francis
- p. 30-58
A Model for Required Professional Development: “MY LIFE IN SEVEN STORIES”
Learning stamps you with its moments. . . . It isn’t steady. It’s a pulse.
- 7 October 2023
- Published by Taylor & Francis
- p. 30-58
A Model for Required Professional Development: “MY LIFE IN SEVEN STORIES”
Learning stamps you with its moments. . . . It isn’t steady. It’s a pulse.
- 6 October 2023
- Published by Taylor & Francis
- p. 193-197
Final Words: MENTORING NEW TALENT
If your actions inspire others to dream more, learn more, do more and become more, you are a leader.
- 6 October 2023
- Published by Taylor & Francis
- p. 193-197
Final Words: MENTORING NEW TALENT
If your actions inspire others to dream more, learn more, do more and become more, you are a leader.
- Open Access
- 9 September 2023
- Published by Center for Open Science in PsyArXiv
Quantifying the Impact of Misinformation and Vaccine-Skeptical Content on Facebook
Low uptake of the COVID-19 vaccine in the US has been widely attributed to social media misinformation. To evaluate this claim, we introduce a framework combining lab experiments (total N=18,725), crowdsourcing, and machine learning to estimate the causal effect of 13,206 vaccine-related URLs on the vaccination intentions of US Facebook users (N≈233 million). We estimate the impact of misinformation flagged by fact-checkers was 46X less than that of unflagged content that nonetheless encouraged vaccine skepticism. Although misinformation reduced vaccination intentions significantly more when viewed, flagged content’s exposure on Facebook was limited. In contrast, unflagged stories highlighting rare deaths following vaccination were among Facebook’s most-viewed stories. Our work emphasizes the need to scrutinize factually accurate but potentially misleading content in addition to outright falsehoods.
- 9 September 2023
- Published by Center for Open Science in PsyArXiv
Open AccessQuantifying the Impact of Misinformation and Vaccine-Skeptical Content on Facebook
Low uptake of the COVID-19 vaccine in the US has been widely attributed to social media misinformation. To evaluate this claim, we introduce a framework combining lab experiments (total N=18,725), crowdsourcing, and machine learning to estimate the causal effect of 13,206 vaccine-related URLs on the vaccination intentions of US Facebook users (N≈233 million). We estimate the impact of misinformation flagged by fact-checkers was 46X less than that of unflagged content that nonetheless encouraged vaccine skepticism. Although misinformation reduced vaccination intentions significantly more when viewed, flagged content’s exposure on Facebook was limited. In contrast, unflagged stories highlighting rare deaths following vaccination were among Facebook’s most-viewed stories. Our work emphasizes the need to scrutinize factually accurate but potentially misleading content in addition to outright falsehoods.
- Top Cited Papers
- 12 January 2023
- Published by Springer Nature in Nature Human Behaviour
- Vol. 7 (3) , 332-341
A 2 million-person, campaign-wide field experiment shows how digital advertising affects voter turnout
We present the results of a large, US$8.9 million campaign-wide field experiment, conducted among 2 million moderate- and low-information persuadable voters in five battleground states during the 2020 US presidential election. Treatment group participants were exposed to an 8-month-long advertising programme delivered via social media, designed to persuade people to vote against Donald Trump and for Joe Biden. We found no evidence that the programme increased or decreased turnout on average. We found evidence of differential turnout effects by modelled level of Trump support: the campaign increased voting among Biden leaners by 0.4 percentage points (s.e. = 0.2 pp) and decreased voting among Trump leaners by 0.3 percentage points (s.e. = 0.3 pp) for a difference in conditional average treatment effects of 0.7 points (t1,035,571 = −2.09; P = 0.036; \(\widehat{{\rm{DIC}}}=0.7\) points; 95% confidence interval = −0.014 to 0). An important but exploratory finding is that the strongest differential effects appear in early voting data, which may inform future work on early campaigning in a post-COVID electoral environment. Our results indicate that differential mobilization effects of even large digital advertising campaigns in presidential elections are likely to be modest.- 12 January 2023
- Published by Springer Nature in Nature Human Behaviour
- Vol. 7 (3) , 332-341
Top Cited PapersA 2 million-person, campaign-wide field experiment shows how digital advertising affects voter turnout
We present the results of a large, US$8.9 million campaign-wide field experiment, conducted among 2 million moderate- and low-information persuadable voters in five battleground states during the 2020 US presidential election. Treatment group participants were exposed to an 8-month-long advertising programme delivered via social media, designed to persuade people to vote against Donald Trump and for Joe Biden. We found no evidence that the programme increased or decreased turnout on average. We found evidence of differential turnout effects by modelled level of Trump support: the campaign increased voting among Biden leaners by 0.4 percentage points (s.e. = 0.2 pp) and decreased voting among Trump leaners by 0.3 percentage points (s.e. = 0.3 pp) for a difference in conditional average treatment effects of 0.7 points (t1,035,571 = −2.09; P = 0.036; \(\widehat{{\rm{DIC}}}=0.7\) points; 95% confidence interval = −0.014 to 0). An important but exploratory finding is that the strongest differential effects appear in early voting data, which may inform future work on early campaigning in a post-COVID electoral environment. Our results indicate that differential mobilization effects of even large digital advertising campaigns in presidential elections are likely to be modest. - Open Access
- 24 October 2022
- Published by Center for Open Science in PsyArXiv
Crowds Can Effectively Identify Misinformation at Scale
Identifying successful approaches for reducing the belief and spread of online misinformation is of great importance. Social media companies currently rely largely on professional fact-checking as their primary mechanism for identifying falsehoods. However, professional fact-checking has notable limitations regarding coverage and speed. In this article, we summarize research suggesting that the ‘wisdom of crowds’ can successfully be harnessed to help identify misinformation at scale. Despite potential concerns about the abilities of laypeople to assess information quality, recent evidence demonstrates that aggregating judgments of groups of laypeople (“crowds”) can effectively identify low-quality news sources and inaccurate news posts: Crowd ratings are strongly correlated with fact-checker ratings across a variety of studies using different designs, stimulus sets, and subject pools. We connect these experimental findings with recent attempts to deploy crowdsourced fact-checking in the field, and close with recommendations and future directions for translating crowdsourced ratings into effective interventions.
- 24 October 2022
- Published by Center for Open Science in PsyArXiv
Open AccessCrowds Can Effectively Identify Misinformation at Scale
Identifying successful approaches for reducing the belief and spread of online misinformation is of great importance. Social media companies currently rely largely on professional fact-checking as their primary mechanism for identifying falsehoods. However, professional fact-checking has notable limitations regarding coverage and speed. In this article, we summarize research suggesting that the ‘wisdom of crowds’ can successfully be harnessed to help identify misinformation at scale. Despite potential concerns about the abilities of laypeople to assess information quality, recent evidence demonstrates that aggregating judgments of groups of laypeople (“crowds”) can effectively identify low-quality news sources and inaccurate news posts: Crowd ratings are strongly correlated with fact-checker ratings across a variety of studies using different designs, stimulus sets, and subject pools. We connect these experimental findings with recent attempts to deploy crowdsourced fact-checking in the field, and close with recommendations and future directions for translating crowdsourced ratings into effective interventions.
- Open Access
- 11 February 2022
- Published by Center for Open Science in PsyArXiv
Understanding and Combating Misinformation Across 16 Countries on Six Continents
The spread of misinformation online is a global problem that requires global solutions. To that end, we conducted an experiment in 16 countries across 6 continents (N = 33,480) to investigate predictors of susceptibility to misinformation and interventions to combat misinformation. In every country, participants with a more analytic cognitive style and stronger accuracy-related motivations were better at discerning truth from falsehood; valuing democracy was also associated with greater truth discernment whereas political conservatism was negatively associated with truth discernment in most countries. Subtly prompting people to think about accuracy was broadly effective at improving the veracity of news that people were willing to share, as were minimal digital literacy tips. Finally, crowdsourced accuracy evaluation was able to differentiate true from false headlines with high accuracy in all countries. The consistent patterns we observe suggest that the psychological factors underlying the misinformation challenge are similar across the globe, and that similar solutions may be broadly effective.
- 11 February 2022
- Published by Center for Open Science in PsyArXiv
Open AccessUnderstanding and Combating Misinformation Across 16 Countries on Six Continents
The spread of misinformation online is a global problem that requires global solutions. To that end, we conducted an experiment in 16 countries across 6 continents (N = 33,480) to investigate predictors of susceptibility to misinformation and interventions to combat misinformation. In every country, participants with a more analytic cognitive style and stronger accuracy-related motivations were better at discerning truth from falsehood; valuing democracy was also associated with greater truth discernment whereas political conservatism was negatively associated with truth discernment in most countries. Subtly prompting people to think about accuracy was broadly effective at improving the veracity of news that people were willing to share, as were minimal digital literacy tips. Finally, crowdsourced accuracy evaluation was able to differentiate true from false headlines with high accuracy in all countries. The consistent patterns we observe suggest that the psychological factors underlying the misinformation challenge are similar across the globe, and that similar solutions may be broadly effective.