Power and Play: Investigating "License to Critique" in Teams' AI Ethics Discussions
Open Access
- 7 November 2024
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (CSCW2) , 1-23
Abstract
Past work has sought to design AI ethics interventions--such as checklists or toolkits--to help practitioners design more ethical AI systems. However, other work demonstrates how these interventions may instead serve to limit critique to that addressed within the intervention, while rendering broader concerns illegitimate. In this paper, drawing on work examining how standards enact discursive closure and how power relations affect whether and how people raise critique, we recruit three corporate teams, and one activist team, each with prior context working with one another, to play a game designed to trigger broad discussion around AI ethics. We use this as a point of contrast to trigger reflection on their teams' past discussions, examining factors which may affect their ''license to critique'' in AI ethics discussions. We then report on how particular affordances of this game may influence discussion, and find that the hypothetical context created in the game is unlikely to be a viable mechanism for real world change. We discuss how power dynamics within a group and notions of ''scope'' affect whether people may be willing to raise critique in AI ethics discussions, and discuss our finding that games are unlikely to enable direct changes to products or practice, but may be more likely to allow members to find critically-aligned allies for future collective action.Keywords
All Related Versions
Funding Information
- NSF (2107298)
- Alfred P. Sloan Foundation (G202014036)
This publication has 39 references indexed in Scilit:
- Virtual communication curbs creative idea generationNature, 2022
- Principles alone cannot guarantee ethical AINature Machine Intelligence, 2019
- The global landscape of AI ethics guidelinesNature Machine Intelligence, 2019
- A Mulching Proposal2019
- Improving Fairness in Machine Learning Systems2019
- License to Critique: A Communication Perspective on Sustainability StandardsBusiness Ethics Quarterly, 2017
- Card-sorting2016
- Operating Room: Relational Spaces and Microinstitutional Change in SurgeryAmerican Journal of Sociology, 2009
- Information sharing and team performance: A meta-analysis.Journal of Applied Psychology, 2009
- Reframing Social Groups, Closure, and Stabilization in the Social Construction of TechnologySocial Epistemology, 2005