Modeling, Replicating, and Predicting Human Behavior: A Survey
Open Access
- 28 May 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Autonomous and Adaptive Systems
- Vol. 18 (2) , 1-47
Abstract
Given the popular presupposition of human reasoning as the standard for learning and decision making, there have been significant efforts and a growing trend in research to replicate these innate human abilities in artificial systems. As such, topics including Game Theory, Theory of Mind, and Machine Learning, among others, integrate concepts that are assumed components of human reasoning. These serve as techniques to replicate and understand the behaviors of humans. In addition, next-generation autonomous and adaptive systems will largely include AI agents and humans working together as teams. To make this possible, autonomous agents will require the ability to embed practical models of human behavior, allowing them not only to replicate human models as a technique to “learn” but also to understand the actions of users and anticipate their behavior, so as to truly operate in symbiosis with them. The main objective of this article is to provide a succinct yet systematic review of important approaches in two areas dealing with quantitative models of human behaviors. Specifically, we focus on (i) techniques that learn a model or policy of behavior through exploration and feedback, such as Reinforcement Learning, and (ii) directly model mechanisms of human reasoning, such as beliefs and bias, without necessarily learning via trial and error.Keywords
Funding Information
- H2020 (952026, CHIST-ERA-19-XAI-010-MUR-484-22)
- European Union under the Italian National Recovery and Resilience Plan (NRRP) of partnership on “Artifical Intelligence: Foundational (PE0000013-program “FAIR”)
This publication has 106 references indexed in Scilit:
- A survey of point-based POMDP solversAutonomous Agents and Multi-Agent Systems, 2012
- Quantum dynamics of human decision-makingJournal of Mathematical Psychology, 2006
- A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategiesThe Knowledge Engineering Review, 2006
- Structure and strength in causal induction☆Cognitive Psychology, 2005
- Instance‐based learning in dynamic decision makingCognitive Science, 2003
- Working Memory: Activation Limitations on RetrievalCognitive Psychology, 1996
- Principles of metareasoningArtificial Intelligence, 1991
- Judgment under Uncertainty: Heuristics and BiasesScience, 1974
- Belief in the law of small numbers.Psychological Bulletin, 1971
- Man as an intuitive statistician.Psychological Bulletin, 1967