Cognitive Models for Machine Theory of Mind
Open Access
- 1 December 2024
- journal article
- research article
- Published by Wiley in Topics in Cognitive Science
- Vol. 17 (2) , 268-290
Abstract
Some of the required characteristics for a true machine theory of mind (MToM) include the ability to (1) reproduce the full diversity of human thought and behavior, (2) develop a personalized model of an individual with very limited data, and (3) provide an explanation for behavioral predictions grounded in the cognitive processes of the individual. We propose that a certain class of cognitive models provide an approach that is well suited to meeting those requirements. Being grounded in a mechanistic framework like a cognitive architecture such as ACT‐R naturally fulfills the third requirement by mapping behavior to cognitive mechanisms. Exploiting a modeling paradigm such as instance‐based learning accounts for the first requirement by reflecting variations in individual experience into a diversity of behavior. Mechanisms such as knowledge tracing and model tracing allow a specific run of the cognitive model to be aligned with a given individual behavior trace, fulfilling the second requirement. We illustrate these principles with a cognitive model of decision‐making in a search and rescue task in the Minecraft simulation environment. We demonstrate that cognitive models personalized to individual human players can provide the MToM capability to optimize artificial intelligence agents by diagnosing the underlying causes of observed human behavior, projecting the future effects of potential interventions, and managing the adaptive process of shaping human behavior. Examples of the inputs provided by such analytic cognitive agents include predictions of cognitive load, probability of error, estimates of player self‐efficacy, and trust calibration. Finally, we discuss implications for future research and applications to collective human–machine intelligence.Keywords
Funding Information
- Defense Advanced Research Projects Agency (HR01120C0037)
This publication has 24 references indexed in Scilit:
- Deep Interpretable Models of Theory of Mind2021
- Decisions from Experience2015
- A Cognitive Model of Dynamic Cooperation With Varied Interdependency InformationCognitive Science, 2014
- Reciprocal trust mediates deep transfer of learning between games of strategic interactionOrganizational Behavior and Human Decision Processes, 2013
- Cognitive Models of Decision Making Processes for Human-Robot Interaction2013
- The Matching LawThe Psychological Record, 2011
- Instance-based learning: Integrating sampling and repeated decisions from experience.Psychological Review, 2011
- Using a model to compute the optimal schedule of practice.Journal of Experimental Psychology: Applied, 2008
- Knowledge tracing: Modeling the acquisition of procedural knowledgeUser Modeling and User-Adapted Interaction, 1995
- YOU CAN'T PLAY 20 QUESTIONS WITH NATURE AND WIN: PROJECTIVE COMMENTS ON THE PAPERS OF THIS SYMPOSIUM1973