Aaron Shaw
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Aaron Shaw has a total of 47 co-authors. Here are the top co-authors by number of shared publications:
- Benjamin Mako Hill
University of Washington
3 shared publications - Eszter Hargittai
University of Zurich, Switzerland
3 shared publications - Sohyeon Hwang
Princeton University
3 shared publications - Charles Kiene
University of Washington, Seattle, WA, USA
2 shared publications - Darren Gergle
Northwestern University, Evanston, Illinois, USA
2 shared publications - Aimei Yang
University of Southern California, Los Angeles, CA, USA
1 shared publication
Latest Publications
- Open Access
- 23 September 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 10 (6) , 1-34
The Relational Origins of Rules in Online Communities
Where do rules come from in online communities? This study investigates how and why online communities adopt and change their rules. We conducted a grounded theory-based analysis of 40 in-depth interviews with community leaders from subreddits, Fandom wikis, and Fediverse servers, and identified seven processes involved in the adoption of online community rules. Our findings reveal that, beyond operational reasons like regulating behavior and solving problems, rules are also adopted and changed for relational reasons, such as signaling or reinforcing community legitimacy and identity to other communities. While rule change was often prompted by challenges during community growth or decline, change also depended on volunteer leaders’ work capacity, the presence of member feedback mechanisms, and relational dynamics between leaders and members. Our findings extend prior theories from social computing and organizational research, illustrating how institutionalist and ecological explanations of the relational origins of rules complement operational accounts. Finally, we build on these explanations to offer a set of design propositions that reflect the relational aspects of rules and rulemaking across communities’ lifecycles.
- 23 September 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 10 (6) , 1-34
Open AccessThe Relational Origins of Rules in Online Communities
Where do rules come from in online communities? This study investigates how and why online communities adopt and change their rules. We conducted a grounded theory-based analysis of 40 in-depth interviews with community leaders from subreddits, Fandom wikis, and Fediverse servers, and identified seven processes involved in the adoption of online community rules. Our findings reveal that, beyond operational reasons like regulating behavior and solving problems, rules are also adopted and changed for relational reasons, such as signaling or reinforcing community legitimacy and identity to other communities. While rule change was often prompted by challenges during community growth or decline, change also depended on volunteer leaders’ work capacity, the presence of member feedback mechanisms, and relational dynamics between leaders and members. Our findings extend prior theories from social computing and organizational research, illustrating how institutionalist and ecological explanations of the relational origins of rules complement operational accounts. Finally, we build on these explanations to offer a set of design propositions that reflect the relational aspects of rules and rulemaking across communities’ lifecycles.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Linguistic Similarity Within Centralized FLOSS Development
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessLinguistic Similarity Within Centralized FLOSS Development
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Governing Together: Toward Infrastructure for Community-Run Social Media
Decentralizing the governance of social computing systems to communities promises to empower them to make independent decisions, with nuance and in context. Yet, communities do not govern in isolation. Many problems communities face are common, or move across their boundaries. We propose designing for inter-community governance: mechanisms that support relationships between communities toward coordinating on governance issues. Drawing from workshops with 24 individuals on decentralized, community-run social media, we present six challenges in designing for inter-community governance surfaced through ideas discussed in workshops. These ideas come together as an ecosystem of resources and tools that highlight three key principles for design: modularity, forkability, and polycentricity. We end with a discussion of how workshop ideas might be implemented in future work aiming to support community governance in social computing more broadly.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessGoverning Together: Toward Infrastructure for Community-Run Social Media
Decentralizing the governance of social computing systems to communities promises to empower them to make independent decisions, with nuance and in context. Yet, communities do not govern in isolation. Many problems communities face are common, or move across their boundaries. We propose designing for inter-community governance: mechanisms that support relationships between communities toward coordinating on governance issues. Drawing from workshops with 24 individuals on decentralized, community-run social media, we present six challenges in designing for inter-community governance surfaced through ideas discussed in workshops. These ideas come together as an ecosystem of resources and tools that highlight three key principles for design: modularity, forkability, and polycentricity. We end with a discussion of how workshop ideas might be implemented in future work aiming to support community governance in social computing more broadly.
- Open Access
This human study did not involve human subjects: Validating LLM simulations as behavioral evidence
A growing literature uses large language models (LLMs) as synthetic participants to generate cost-effective and nearly instantaneous responses in social science experiments. However, there is limited guidance on when such simulations support valid inference about human behavior. We contrast two strategies for obtaining valid estimates of causal effects and clarify the assumptions under which each is suitable for exploratory versus confirmatory research. Heuristic approaches seek to establish that simulated and observed human behavior are interchangeable through prompt engineering, model fine-tuning, and other repair strategies designed to reduce LLM-induced inaccuracies. While useful for many exploratory tasks, heuristic approaches lack the formal statistical guarantees typically required for confirmatory research. In contrast, statistical calibration combines auxiliary human data with statistical adjustments to account for discrepancies between observed and simulated responses. Under explicit assumptions, statistical calibration preserves validity and provides more precise estimates of causal effects at lower cost than experiments that rely solely on human participants. Yet the potential of both approaches depends on how well LLMs approximate the relevant populations. We consider what opportunities are overlooked when researchers focus myopically on substituting LLMs for human participants in a study.
Open AccessThis human study did not involve human subjects: Validating LLM simulations as behavioral evidence
A growing literature uses large language models (LLMs) as synthetic participants to generate cost-effective and nearly instantaneous responses in social science experiments. However, there is limited guidance on when such simulations support valid inference about human behavior. We contrast two strategies for obtaining valid estimates of causal effects and clarify the assumptions under which each is suitable for exploratory versus confirmatory research. Heuristic approaches seek to establish that simulated and observed human behavior are interchangeable through prompt engineering, model fine-tuning, and other repair strategies designed to reduce LLM-induced inaccuracies. While useful for many exploratory tasks, heuristic approaches lack the formal statistical guarantees typically required for confirmatory research. In contrast, statistical calibration combines auxiliary human data with statistical adjustments to account for discrepancies between observed and simulated responses. Under explicit assumptions, statistical calibration preserves validity and provides more precise estimates of causal effects at lower cost than experiments that rely solely on human participants. Yet the potential of both approaches depends on how well LLMs approximate the relevant populations. We consider what opportunities are overlooked when researchers focus myopically on substituting LLMs for human participants in a study.
- Open Access
Recommended Practices for NPOV Research on Wikipedia
Writing Wikipedia with a neutral point of view is one of the five pillars of Wikipedia. Although the topic is core to Wikipedia, it is relatively understudied considering hundreds of research studies are published annually about the project. We hypothesize that part of the reason for the low research activity on the topic is that Wikipedia's definition of neutrality and its importance are not well understood within the research community. Neutrality is also an inherently challenging and contested concept. Our aim with this paper is to accelerate high quality research in this space that can help Wikipedia communities continue to improve their work in writing the encyclopedia. We do this by helping researchers to learn what Neutral Point of View means in the context of Wikipedia, identifying some common challenges with studying NPOV and how to navigate them, and offering guidance on how researchers can communicate the results of their work for increased impact on the ground for the benefit of Wikipedia.
Open AccessRecommended Practices for NPOV Research on Wikipedia
Writing Wikipedia with a neutral point of view is one of the five pillars of Wikipedia. Although the topic is core to Wikipedia, it is relatively understudied considering hundreds of research studies are published annually about the project. We hypothesize that part of the reason for the low research activity on the topic is that Wikipedia's definition of neutrality and its importance are not well understood within the research community. Neutrality is also an inherently challenging and contested concept. Our aim with this paper is to accelerate high quality research in this space that can help Wikipedia communities continue to improve their work in writing the encyclopedia. We do this by helping researchers to learn what Neutral Point of View means in the context of Wikipedia, identifying some common challenges with studying NPOV and how to navigate them, and offering guidance on how researchers can communicate the results of their work for increased impact on the ground for the benefit of Wikipedia.
- Open Access
- 30 May 2025
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 11 (22) , eady9839
Misinformation research continues to be urgent science
- 30 May 2025
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 11 (22) , eady9839
Open AccessMisinformation research continues to be urgent science
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Human Subjects Research in the Age of Generative AI: Opportunities and Challenges of Applying LLM-Simulated Data to HCI Studies
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessHuman Subjects Research in the Age of Generative AI: Opportunities and Challenges of Applying LLM-Simulated Data to HCI Studies
- Open Access
- 17 April 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (CSCW1) , 1-26
Adopting Third-party Bots for Managing Online Communities
Bots have become critical for managing online communities on platforms, especially to match the increasing technical sophistication of online harms. However, community leaders often adoptthird-party bots, creating room for misalignment in their assumptions, expectations, and understandings (i.e., their technological frames) about them. On platforms where sharing bots can be extremely valuable, how community leaders can revise their frames about bots to more effectively adopt them is unclear. In this work, we conducted a qualitative interview study with 16 community leaders on Discord examining how they adopt third-party bots. We found that participants addressed challenges stemming from uncertainties about a bot's security, reliability, and fit through emergent social ecosystems. Formal and informal opportunities to discuss bots with others across communities enabled participants to revise their technological frames over time, closing gaps in bot-specific skills and knowledge. This social process of learning shifted participants' perspectives of the labor of bot adoption into something that was satisfying and fun, underscoring the value of collaborative and communal approaches to adopting bots. Finally, by shaping participants' mental models of the nature, value, and use of bots, social ecosystems also raise some practical tensions in how they support user creativity and customization in third-party bot use. Together, the social nature of adopting third-party bots in our interviews offers insight into how we can better support the sharing of valuable user-facing tools across online communities.
- 17 April 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (CSCW1) , 1-26
Open AccessAdopting Third-party Bots for Managing Online Communities
Bots have become critical for managing online communities on platforms, especially to match the increasing technical sophistication of online harms. However, community leaders often adoptthird-party bots, creating room for misalignment in their assumptions, expectations, and understandings (i.e., their technological frames) about them. On platforms where sharing bots can be extremely valuable, how community leaders can revise their frames about bots to more effectively adopt them is unclear. In this work, we conducted a qualitative interview study with 16 community leaders on Discord examining how they adopt third-party bots. We found that participants addressed challenges stemming from uncertainties about a bot's security, reliability, and fit through emergent social ecosystems. Formal and informal opportunities to discuss bots with others across communities enabled participants to revise their technological frames over time, closing gaps in bot-specific skills and knowledge. This social process of learning shifted participants' perspectives of the labor of bot adoption into something that was satisfying and fun, underscoring the value of collaborative and communal approaches to adopting bots. Finally, by shaping participants' mental models of the nature, value, and use of bots, social ecosystems also raise some practical tensions in how they support user creativity and customization in third-party bot use. Together, the social nature of adopting third-party bots in our interviews offers insight into how we can better support the sharing of valuable user-facing tools across online communities.
- Open Access
- 1 September 2023
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 9 (35) , eadk2031
Social media, extremism, and radicalization
Fears that YouTube recommendations radicalize users are overblown, but social media still host and profit from dubious and extremist content.
- 1 September 2023
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 9 (35) , eadk2031
Open AccessSocial media, extremism, and radicalization
Fears that YouTube recommendations radicalize users are overblown, but social media still host and profit from dubious and extremist content.
- Open Access
- 16 March 2023
- Published by Oxford University Press (OUP) in Journal of Computer-Mediated Communication
- Vol. 28 (3)
Communication networks do not predict success in attempts at peer production
Although peer production has created valuable information goods like Wikipedia, the GNU/Linux operating system, and Reddit, the majority of attempts at peer production achieve very little. In work groups and teams, coordination and social integration—manifested via dense, integrative communication networks—predict success. We hypothesize that the conditions in which new peer production communities operate make communication problems common and make coordination and integration more difficult, and that variation in the structure of project communication networks will predict project success. In this article, we measure communication networks for 999 early-stage peer production wikis. We assess whether communities displaying network markers of coordination and social integration are more productive and long-lasting. Contrary to our expectations, we find a very weak relationship between communication structure and collaborative performance. We propose that technology may serve as a partial substitute for communication in coordinating work and integrating newcomers in peer production.
- 16 March 2023
- Published by Oxford University Press (OUP) in Journal of Computer-Mediated Communication
- Vol. 28 (3)
Open AccessCommunication networks do not predict success in attempts at peer production
Although peer production has created valuable information goods like Wikipedia, the GNU/Linux operating system, and Reddit, the majority of attempts at peer production achieve very little. In work groups and teams, coordination and social integration—manifested via dense, integrative communication networks—predict success. We hypothesize that the conditions in which new peer production communities operate make communication problems common and make coordination and integration more difficult, and that variation in the structure of project communication networks will predict project success. In this article, we measure communication networks for 999 early-stage peer production wikis. We assess whether communities displaying network markers of coordination and social integration are more productive and long-lasting. Contrary to our expectations, we find a very weak relationship between communication structure and collaborative performance. We propose that technology may serve as a partial substitute for communication in coordinating work and integrating newcomers in peer production.