Jacob Erickson
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Jacob Erickson has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Bei Yan
Stevens Institute of Technology
2 shared publications Bei Yan
Stevens Institute of Technology, USA
1 shared publicationJewel Y. Yuzon
Khoury College of Computer Sciences, Northeastern University, Seattle, WA, USA
1 shared publicationJingyun Huang
Stevens Institute of Technology, USA
1 shared publication- Tamara Bonaci
Khoury College of Computer Sciences, Northeastern University Seattle, Seattle, WA, USA
1 shared publication
Latest Publications
- Open Access
- 26 October 2026
- Published by Center for Open Science in SocArXiv
The Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AI
As conversational AI systems become a larger part of the media landscape, they raise questions about whose interests they serve and the risks they may pose to users. These systems do more than provide information: they increasingly offer advice and companionship through interfaces that can appear supportive and socially responsive. A pressing concern is that users may form social or interpersonal relationships with these systems and place relational trust in them, even when the interests shaping interactions do not fully align with their own. The Fake Friend Dilemma (FFD) describes the problem that follows: the same relational trust that makes conversational AI useful can also leave users open to manipulation and exploitation when institutional interests conflict with their own. Drawing on work on trust, AI alignment, dark patterns, and surveillance capitalism, the paper considers how the FFD can manifest through product sales, propaganda and biased information, behavioral nudging, and surveillance. It also considers possible structural and technical mitigation strategies. The FFD is not simply about AI misleading users. The problem it surfaces is that the trust people place in these systems can itself become a resource for institutional actors seeking to influence behavior or extract information. The FFD is therefore as much a problem of media governance and political economy as it is a technological one.
- 26 October 2026
- Published by Center for Open Science in SocArXiv
Open AccessThe Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AI
As conversational AI systems become a larger part of the media landscape, they raise questions about whose interests they serve and the risks they may pose to users. These systems do more than provide information: they increasingly offer advice and companionship through interfaces that can appear supportive and socially responsive. A pressing concern is that users may form social or interpersonal relationships with these systems and place relational trust in them, even when the interests shaping interactions do not fully align with their own. The Fake Friend Dilemma (FFD) describes the problem that follows: the same relational trust that makes conversational AI useful can also leave users open to manipulation and exploitation when institutional interests conflict with their own. Drawing on work on trust, AI alignment, dark patterns, and surveillance capitalism, the paper considers how the FFD can manifest through product sales, propaganda and biased information, behavioral nudging, and surveillance. It also considers possible structural and technical mitigation strategies. The FFD is not simply about AI misleading users. The problem it surfaces is that the trust people place in these systems can itself become a resource for institutional actors seeking to influence behavior or extract information. The FFD is therefore as much a problem of media governance and political economy as it is a technological one.
- Open Access
- 17 September 2026
- Published by Elsevier in SSRN Electronic Journal
The Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AI
As conversational AI systems become a larger part of the media landscape, they raise questions about whose interests they serve and the risks they may pose to users. These systems do more than provide information: they increasingly offer advice and companionship through interfaces that can appear supportive and socially responsive. A pressing concern is that users may form perceived social relationships with these systems and place relational trust in them, even when the interests shaping interactions do not fully align with their own. The Fake Friend Dilemma (FFD) describes the problem that follows: the same relational trust that makes conversational AI useful can also leave users open to manipulation and exploitation when institutional interests conflict with their own. Drawing on work on relational trust, AI alignment, extractive design, and the political economy of communication, the paper considers how the FFD can manifest through product sales, propaganda and biased information, surveillance, and behavioral nudging. It also considers possible structural and technical mitigation strategies. The FFD is not simply about AI misleading users. The problem it surfaces is that the trust people place in these systems can itself become a resource for institutional actors seeking to influence behavior or extract information. The FFD is therefore as much a problem of media governance and political economy as it is a technological one.
- 17 September 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessThe Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AI
As conversational AI systems become a larger part of the media landscape, they raise questions about whose interests they serve and the risks they may pose to users. These systems do more than provide information: they increasingly offer advice and companionship through interfaces that can appear supportive and socially responsive. A pressing concern is that users may form perceived social relationships with these systems and place relational trust in them, even when the interests shaping interactions do not fully align with their own. The Fake Friend Dilemma (FFD) describes the problem that follows: the same relational trust that makes conversational AI useful can also leave users open to manipulation and exploitation when institutional interests conflict with their own. Drawing on work on relational trust, AI alignment, extractive design, and the political economy of communication, the paper considers how the FFD can manifest through product sales, propaganda and biased information, surveillance, and behavioral nudging. It also considers possible structural and technical mitigation strategies. The FFD is not simply about AI misleading users. The problem it surfaces is that the trust people place in these systems can itself become a resource for institutional actors seeking to influence behavior or extract information. The FFD is therefore as much a problem of media governance and political economy as it is a technological one.
- Open Access
- 21 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Who Does Your AI Work For? Designing Conversational Agents as Digital Fiduciaries
Conversational agents are increasingly integrated into the most private and intimate aspects of users’ lives, from discussions of mental health to financial decisions. As a result, these systems have access to reams of sensitive user data. Much of the literature on AI systems has focused on aligning users’ goals with the agents that act on their behalf. While this work is vitally important, it may overlook the need to establish a new normative baseline. Conversational AI agents, designed to feel and interact anthropomorphically with human users, must be held to a standard of care commensurate with their capabilities and access. When a client hires a personal lawyer, undergoes surgery, or receives advice from an investment manager, the expert they consult often has a fiduciary duty to act in their client’s best interests. This provocation argues that conversational agents should be held to a similar standard and introduces fiduciary design as a guiding principle. In this respect, conversational AI trust and accountability could be unified into a single design and legal paradigm.
- 21 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessWho Does Your AI Work For? Designing Conversational Agents as Digital Fiduciaries
Conversational agents are increasingly integrated into the most private and intimate aspects of users’ lives, from discussions of mental health to financial decisions. As a result, these systems have access to reams of sensitive user data. Much of the literature on AI systems has focused on aligning users’ goals with the agents that act on their behalf. While this work is vitally important, it may overlook the need to establish a new normative baseline. Conversational AI agents, designed to feel and interact anthropomorphically with human users, must be held to a standard of care commensurate with their capabilities and access. When a client hires a personal lawyer, undergoes surgery, or receives advice from an investment manager, the expert they consult often has a fiduciary duty to act in their client’s best interests. This provocation argues that conversational agents should be held to a similar standard and introduces fiduciary design as a guiding principle. In this respect, conversational AI trust and accountability could be unified into a single design and legal paradigm.
- Open Access
- 19 August 2025
- Published by Center for Open Science in SocArXiv
Rethinking the filter bubble? Developing a research agenda for the protective filter bubble
Filter bubbles and echo chambers have received global attention from scholars, media organizations, and the general public. Filter bubbles have primarily been regarded as intrinsically negative, and many studies have sought to minimize their influence. The detrimental influence of filter bubbles is well-studied. Filter bubbles may, for example, create information silos, amplify misinformation, and promote hatred and extremism. However, comparatively few studies have considered the other side of the filter bubble; its protective benefits, particularly to marginalized communities and those living in countries with low levels of press freedom. Through a review of the literature on digital safe spaces and protective filter bubbles, this commentary suggests that there may be a need to rethink the filter bubble, and it proposes several areas for future research.
- 19 August 2025
- Published by Center for Open Science in SocArXiv
Open AccessRethinking the filter bubble? Developing a research agenda for the protective filter bubble
Filter bubbles and echo chambers have received global attention from scholars, media organizations, and the general public. Filter bubbles have primarily been regarded as intrinsically negative, and many studies have sought to minimize their influence. The detrimental influence of filter bubbles is well-studied. Filter bubbles may, for example, create information silos, amplify misinformation, and promote hatred and extremism. However, comparatively few studies have considered the other side of the filter bubble; its protective benefits, particularly to marginalized communities and those living in countries with low levels of press freedom. Through a review of the literature on digital safe spaces and protective filter bubbles, this commentary suggests that there may be a need to rethink the filter bubble, and it proposes several areas for future research.
- Open Access
- 13 August 2025
- Published by Center for Open Science in SocArXiv
Fake Friends and Sponsored Ads: The Risks of Advertising in Conversational Search
Digital commerce thrives on advertising, with many of the largest technology companies relying on it as a significant source of revenue. However, in the context of information-seeking behavior, such as search, advertising may degrade the user experience by lowering search quality, misusing user data for inappropriate personalization, potentially misleading individuals, or even leading them toward harm. These challenges remain significant as conversational search technologies, such as ChatGPT, become widespread. This paper critically examines the future of advertising in conversational search, utilizing several speculative examples to illustrate the potential risks posed to users who seek guidance on sensitive topics. Additionally, it provides an overview of the forms that advertising might take in this space and introduces the “fake friend dilemma,” the idea that a conversational agent may exploit unaligned user trust to achieve other objectives. This study presents a provocative discussion on the future of online advertising in the space of conversational search and ends with a call to action.
- 13 August 2025
- Published by Center for Open Science in SocArXiv
Open AccessFake Friends and Sponsored Ads: The Risks of Advertising in Conversational Search
Digital commerce thrives on advertising, with many of the largest technology companies relying on it as a significant source of revenue. However, in the context of information-seeking behavior, such as search, advertising may degrade the user experience by lowering search quality, misusing user data for inappropriate personalization, potentially misleading individuals, or even leading them toward harm. These challenges remain significant as conversational search technologies, such as ChatGPT, become widespread. This paper critically examines the future of advertising in conversational search, utilizing several speculative examples to illustrate the potential risks posed to users who seek guidance on sensitive topics. Additionally, it provides an overview of the forms that advertising might take in this space and introduces the “fake friend dilemma,” the idea that a conversational agent may exploit unaligned user trust to achieve other objectives. This study presents a provocative discussion on the future of online advertising in the space of conversational search and ends with a call to action.
- Open Access
- 7 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Fake Friends and Sponsored Ads: The Risks of Advertising in Conversational Search
- 7 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessFake Friends and Sponsored Ads: The Risks of Advertising in Conversational Search
- Open Access
- 2 May 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (2) , 1-18
Content Moderation and Hate Speech on Alternative Platforms: A Case Study of BitChute
Frustration with mainstream social media platforms and their content moderation decisions have prompted many users to search for "anti-censorship" alternatives, such as those in alt-tech, which may be used to share extreme or hateful content. The tension in alt-tech between limiting perceived censorship and reducing hate speech means that content moderation policies are essential but also controversial. Nevertheless, alt-tech content moderation policies are understudied. To address this research gap, we leverage quasi-experimental design to measure the impact of an "incitement to hatred" policy change using 5.2 million comments and the metadata of 800 thousand videos from the alt-tech platform BitChute. We uncover evidence for a "backlash effect," finding that after the implementation of the policy, hate speech increased significantly for comments and video metadata. This study contributes to the literature on content moderation policies in a challenging context where users may not be receptive to perceived impositions.
- 2 May 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (2) , 1-18
Open AccessContent Moderation and Hate Speech on Alternative Platforms: A Case Study of BitChute
Frustration with mainstream social media platforms and their content moderation decisions have prompted many users to search for "anti-censorship" alternatives, such as those in alt-tech, which may be used to share extreme or hateful content. The tension in alt-tech between limiting perceived censorship and reducing hate speech means that content moderation policies are essential but also controversial. Nevertheless, alt-tech content moderation policies are understudied. To address this research gap, we leverage quasi-experimental design to measure the impact of an "incitement to hatred" policy change using 5.2 million comments and the metadata of 800 thousand videos from the alt-tech platform BitChute. We uncover evidence for a "backlash effect," finding that after the implementation of the policy, hate speech increased significantly for comments and video metadata. This study contributes to the literature on content moderation policies in a challenging context where users may not be receptive to perceived impositions.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Affective Design: The Influence of Facebook Reactions on the Emotional Expression of the 114th US Congress
Political communication is critical for democracy, but polarized emotions in communication may make careful deliberation difficult. Much of modern political communication occurs on social media, which may exacerbate these challenges. This study examines how the design of social media features impact political communication. We examined how the introduction of Facebook Reactions influenced the posts of the 114th US Congress on the platform. We start by analyzing the emotional content of posts, finding that politicians generally increased their usage of negative emotions in their posts after the feature’s launch. Further analysis showed that increased user engagement preceded the rise in negative emotions, suggesting that politicians were making adjustments based on user feedback. Our results show that the design features of social media can shape online political communication.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessAffective Design: The Influence of Facebook Reactions on the Emotional Expression of the 114th US Congress
Political communication is critical for democracy, but polarized emotions in communication may make careful deliberation difficult. Much of modern political communication occurs on social media, which may exacerbate these challenges. This study examines how the design of social media features impact political communication. We examined how the introduction of Facebook Reactions influenced the posts of the 114th US Congress on the platform. We start by analyzing the emotional content of posts, finding that politicians generally increased their usage of negative emotions in their posts after the feature’s launch. Further analysis showed that increased user engagement preceded the rise in negative emotions, suggesting that politicians were making adjustments based on user feedback. Our results show that the design features of social media can shape online political communication.
- Open Access
- 8 February 2024
- Published by SAGE Publications in Big Data & Society
- Vol. 11 (1)
Rethinking the filter bubble? Developing a research agenda for the protective filter bubble
Filter bubbles and echo chambers have received global attention from scholars, media organizations, and the general public. Filter bubbles have primarily been regarded as intrinsically negative, and many studies have sought to minimize their influence. The detrimental influence of filter bubbles is well-studied. Filter bubbles may, for example, create information silos, amplify misinformation, and promote hatred and extremism. However, comparatively few studies have considered the other side of the filter bubble; its protective benefits, particularly to marginalized communities and those living in countries with low levels of press freedom. Through a review of the literature on digital safe spaces and protective filter bubbles, this commentary suggests that there may be a need to rethink the filter bubble, and it proposes several areas for future research.
- 8 February 2024
- Published by SAGE Publications in Big Data & Society
- Vol. 11 (1)
Open AccessRethinking the filter bubble? Developing a research agenda for the protective filter bubble
Filter bubbles and echo chambers have received global attention from scholars, media organizations, and the general public. Filter bubbles have primarily been regarded as intrinsically negative, and many studies have sought to minimize their influence. The detrimental influence of filter bubbles is well-studied. Filter bubbles may, for example, create information silos, amplify misinformation, and promote hatred and extremism. However, comparatively few studies have considered the other side of the filter bubble; its protective benefits, particularly to marginalized communities and those living in countries with low levels of press freedom. Through a review of the literature on digital safe spaces and protective filter bubbles, this commentary suggests that there may be a need to rethink the filter bubble, and it proposes several areas for future research.
- Open Access
- 1 July 2023
- Published by SAGE Publications in Social Media + Society
- Vol. 9 (3)
Bridging Echo Chambers? Understanding Political Partisanship through Semantic Network Analysis
In an era of intense partisanship, there is widespread concern that people are self-sorting into separate online communities which are detached from one another. Referred to as echo chambers, the phenomenon is sometimes attributed to the new media landscape and internet ecosystem. Of particular concern is the idea that communication between disparate groups is breaking down due to a lack of a shared reality. In this article, we look to evaluate these assumptions. Applying text and semantic network analyses, we study the language of users who represent distinct partisan political ideologies on Reddit and their discussions in light of the January 6, 2021, Capitol Riots. By analyzing over 58k posts and 3.4 million comments across three subreddits, r/politics, r/democrats, and r/Republican, we explore how these distinct groups discuss political events to understand the possibility of bridging across echo chambers. The findings of this research study provide insight into how members of distinct online groups interpret major political events.
- 1 July 2023
- Published by SAGE Publications in Social Media + Society
- Vol. 9 (3)
Open AccessBridging Echo Chambers? Understanding Political Partisanship through Semantic Network Analysis
In an era of intense partisanship, there is widespread concern that people are self-sorting into separate online communities which are detached from one another. Referred to as echo chambers, the phenomenon is sometimes attributed to the new media landscape and internet ecosystem. Of particular concern is the idea that communication between disparate groups is breaking down due to a lack of a shared reality. In this article, we look to evaluate these assumptions. Applying text and semantic network analyses, we study the language of users who represent distinct partisan political ideologies on Reddit and their discussions in light of the January 6, 2021, Capitol Riots. By analyzing over 58k posts and 3.4 million comments across three subreddits, r/politics, r/democrats, and r/Republican, we explore how these distinct groups discuss political events to understand the possibility of bridging across echo chambers. The findings of this research study provide insight into how members of distinct online groups interpret major political events.