The role of mental simulation in primate physical inference abilities
Preprint
Abstract
Primates can richly parse sensory inputs to infer latent information, and adjust their behavior accordingly. It has been hypothesized that such flexible inferences are aided by simulations of internal models of the external world. However, evidence supporting this hypothesis has been based on behavioral models that do not emulate neural computations. Here, we test this hypothesis by directly comparing the behavior of humans and monkeys in a ball interception task to that of recurrent neural network (RNN) models with or without the capacity to “simulate” the underlying latent variables. Humans and monkeys had strikingly similar behavioral patterns suggesting common underlying neural computations. Comparison between primates and a large class of RNNs revealed that only RNNs that were optimized to simulate the position of the ball were able to accurately capture key features of the behavior such as systematic biases in the inference process. These results are consistent with the hypothesis that primates use mental simulation to make flexible inferences. Moreover, our work highlights a general strategy for using model neural systems to test computational hypotheses of higher brain function.Keywords
This publication has 40 references indexed in Scilit:
- Context-dependent computation by recurrent dynamics in prefrontal cortexNature, 2013
- Simulation as an engine of physical scene understandingProceedings of the National Academy of Sciences of the United States of America, 2013
- Opening the Black Box: Low-Dimensional Dynamics in High-Dimensional Recurrent Neural NetworksNeural Computation, 2013
- A Three-Dimensional Spatiotemporal Receptive Field Model Explains Responses of Area MT Neurons to Naturalistic MoviesThe Journal of Neuroscience, 2011
- How to Grow a Mind: Statistics, Structure, and AbstractionScience, 2011
- Using Imagination to Understand the Neural Basis of Episodic MemoryThe Journal of Neuroscience, 2007
- Mechanical reasoning by mental simulationTrends in Cognitive Sciences, 2004
- Approximation of dynamical systems by continuous time recurrent neural networksNeural Networks, 1993
- Counterfactual reasoning and accuracy in predicting personal events.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1985
- Mental Rotation of Three-Dimensional ObjectsScience, 1971