LLMs achieve adult human performance on higher-order theory of mind tasks
Authors:
Top Cited Papers
Open Access
- 2 January 2026
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 19, 1633272
Abstract
This paper examines the extent to which large language models (LLMs) are able to perform tasks which require higher-order theory of mind (ToM)—the human ability to reason about multiple mental and emotional states in a recursive manner (e.g., I think that you believe that she knows ). This paper builds on prior work by introducing a handwritten test suite—Multi-Order Theory of Mind Q&A—and using it to compare the performance of five LLMs of varying sizes and training paradigms to a newly gathered adult human benchmark. We find that GPT-4 and Flan-PaLM reach adult-level and near adult-level performance on our ToM tasks overall, and that GPT-4 exceeds adult performance on 6th order inferences. Our results suggest that there is an interplay between model size and finetuning for higher-order ToM performance, and that the linguistic abilities of large models may support more complex ToM inferences. Given the important role that higher-order ToM plays in group social interaction and relationships, these findings have significant implications for the development of a broad range of social, educational and assistive LLM applications.Keywords
All Related Versions
This publication has 71 references indexed in Scilit:
- A survey on large language model based autonomous agentsFrontiers of Computer Science, 2024
- Higher-order theory of mind is especially useful in unpredictable negotiationsAutonomous Agents and Multi-Agent Systems, 2022
- Google Colaboratory2019
- Negotiating with other minds: the role of recursive theory of mind in negotiation with incomplete informationAutonomous Agents and Multi-Agent Systems, 2015
- The Complexity of Jokes Is Limited by Cognitive Constraints on MentalizingHuman Nature, 2015
- A Systematic Review of Psychosocial Interventions for Adults with Autism Spectrum DisordersJournal of Autism and Developmental Disorders, 2012
- Theory of Mind Training in Children with Autism: A Randomized Controlled TrialJournal of Autism and Developmental Disorders, 2010
- An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adultsJournal of Autism and Developmental Disorders, 1994
- Does the autistic child have a “theory of mind” ?Cognition, 1985
- Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deceptionCognition, 1983