AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stages
Open Access
- 23 September 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 10 (6) , 1-33
Abstract
Responsible AI (RAI) efforts increasingly emphasize the importance of addressing potential harms early in the AI development lifecycle through social-technical lenses. However, in cross-functional industry teams, this work is often stalled by a persistent coordination challenge: how technical roles hand off technical intent, how teams establish shared structures for collaboration, and how non-technical roles are supported in systematically evaluating harms. Through literature review and a semi-structured interview study with 8 practitioners, we unpack how this challenge manifests—technical design choices are rarely handed off in ways that support meaningful engagement by non-technical roles; collaborative workflows lack shared, visual structures to support mutual understanding; and non-technical practitioners are left without scaffolds for systematic harm evaluation. Existing tools like JIRA or Google Docs, while useful for product tracking, are ill-suited for supporting joint harm identification across roles, often requiring significant extra effort to align understanding. To address this, we developed AI LEGO, a web-based prototype that operationalizes the boundary object theory to support cross-functional AI practitioners in effectively facilitating knowledge handoff and identifying harmful design choices in the early design stages. Technical roles use interactive blocks to draft development plans, while non-technical roles engage with those blocks through stage-specific checklists and LLM-driven persona simulations to surface potential harms. In a study with 18 cross-functional practitioners, AI LEGO increased the volume and likelihood of harms identified compared to baseline worksheets. Participants found that its modular structure and persona prompts made harm identification more accessible, fostering clearer and more collaborative RAI practices in early design.Keywords
All Related Versions
This publication has 59 references indexed in Scilit:
- No such thing as one-size-fits-all in AI ethics frameworks: a comparative case studyAI & SOCIETY, 2023
- The What-If Tool: Interactive Probing of Machine Learning ModelsIEEE Transactions on Visualization and Computer Graphics, 2019
- Using Affinity Diagrams to Evaluate Interactive Prototypes2015
- Speculative design: crafting the speculationDigital Creativity, 2013
- The envisioning cards2012
- Steps Across the Border – Cooperation, Knowledge Production and Systems DesignComputer Supported Cooperative Work (CSCW), 2002
- Coordination mechanisms: Towards a conceptual foundation of CSCW systems designComputer Supported Cooperative Work (CSCW), 1996
- Taking CSCW seriouslyComputer Supported Cooperative Work (CSCW), 1992
- The Articulation of Project Work: An Organizational ProcessThe Sociological Quarterly, 1988
- Complete Counterbalancing of Immediate Sequential Effects in a Latin Square DesignJournal of the American Statistical Association, 1958