The Indispensable Role of User Simulation in the Pursuit of AGI
Preprint
Abstract
Progress toward Artificial General Intelligence (AGI) faces significant bottlenecks, particularly in rigorously evaluating complex interactive systems and acquiring the vast interaction data needed for training adaptive agents. This paper posits that user simulation -- creating computational agents that mimic human interaction with AI systems -- is not merely a useful tool, but is a critical catalyst required to overcome these bottlenecks and accelerate AGI development. We argue that realistic simulators provide the necessary environments for scalable evaluation, data generation for interactive learning, and fostering the adaptive capabilities central to AGI. Therefore, research into user simulation technology and intelligent task agents are deeply synergistic and must advance hand-in-hand. This article elaborates on the critical role of user simulation for AGI, explores the interdisciplinary nature of building realistic simulators, identifies key challenges including those posed by large language models, and proposes a future research agenda.Keywords
All Related Versions
- Version 1, 2025-09-23, ArXiv
- Published version: Communications of the ACM, 69 (5), 45.
This publication has 6 references indexed in Scilit:
- Large language models empowered agent-based modeling and simulation: a survey and perspectivesHumanities and Social Sciences Communications, 2024
- User Simulation for Evaluating Information Access SystemsFoundations and Trends® in Information Retrieval, 2024
- A survey on large language model based autonomous agentsFrontiers of Computer Science, 2024
- Neurosymbolic AI: the 3rd waveArtificial Intelligence Review, 2023
- Out of One, Many: Using Language Models to Simulate Human SamplesPolitical Analysis, 2023
- Does the chimpanzee have a theory of mind?Behavioral and Brain Sciences, 1978