Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgment
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-48
Abstract
AI impact assessments often stress near-term risks because human judgment degrades over longer horizons, exemplifying the Collingridge dilemma: foresight is most needed when knowledge is scarcest. To address long-term systemic risks, we introduce a scalable approach that simulates in-silico agents using the foresight method of the Futures Wheel. We applied it to four AI uses spanning Technology Readiness Levels (TRLs): Chatbot Companion (TRL 9), AI Toy (TRL 7), Griefbot (TRL 5), and Death App (TRL 2). Across 30 agent runs per use, agents produced 86–110 consequences, condensed into 27–47 unique risks. To benchmark the agent outputs against human perspectives, we collected evaluations from 290 domain experts and 7 leaders, and conducted Futures Wheel sessions with 42 experts and 42 laypeople. Agents generated many systemic consequences. Compared with these outputs, experts identified fewer risks, typically less systemic but judged more likely, whereas laypeople surfaced more emotionally salient concerns that were generally less systemic. We propose a hybrid foresight workflow, wherein agents broaden systemic coverage, and humans provide contextual grounding.Keywords
All Related Versions
This publication has 77 references indexed in Scilit:
- Griefbots, Deadbots, Postmortem Avatars: on Responsible Applications of Generative AI in the Digital Afterlife IndustryPhilosophy & Technology, 2024
- A global scale comparison of risk aggregation in AI assessment frameworksAI and Ethics, 2024
- AI Risk Assessment: A Scenario-Based, Proportional Methodology for the AI ActDigital Society, 2024
- Taking AI risks seriously: a new assessment model for the AI ActAI & SOCIETY, 2023
- From the Perspective of Capability: Identifying Six Roles for a Successful Strategic Foresight ProcessStrategic Change, 2016
- PEST analysis2015
- The Factor Structure of the System Usability Scale2009
- Advances in prospect theory: Cumulative representation of uncertaintyJournal of Risk and Uncertainty, 1992
- Counterintuitive behavior of social systemsTheory and Decision, 1971
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948