Inferring internal states across mice and monkeys using facial features
Authors:
- Alejandro TlaieATAlejandro Tlaie
- Muad Y. Abd El HayMHMuad Y. Abd El Hay
- Robert TaylorRTRobert Taylor
- Pierre-Antoine FerracciPFPierre-Antoine Ferracci
- Katharine ShapcottKSKatharine Shapcott
- Jonathan W. PillowJPJonathan W. Pillow
- Martha N. HavenithMHMartha N. Havenith
- Marieke L. SchölvinckMSMarieke L. Schölvinck
Open Access
- 4 June 2025
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 16 (1) , 1-16
Abstract
Animal behaviour is shaped to a large degree by internal cognitive states, but it is unknown whether these states are similar across species. To address this question, here we develop a virtual reality setup in which male mice and macaques engage in the same naturalistic visual foraging task. We exploit the richness of a wide range of facial features extracted from video recordings during the task, to train a Markov-Switching Linear Regression (MSLR). By doing so, we identify, on a single-trial basis, a set of internal states that reliably predicts when the animals are going to react to the presented stimuli. Even though the model is trained purely on reaction times, it can also predict task outcome, supporting the behavioural relevance of the inferred states. The relationship of the identified states to task performance is comparable between mice and monkeys. Furthermore, each state corresponds to a characteristic pattern of facial features that partially overlaps between species, highlighting the importance of facial expressions as manifestations of internal cognitive states across species.Keywords
All Related Versions
Funding Information
- Max-Planck-Gesellschaft
- Ministerio de Economía y Competitividad (Margarita Salas Fellowship)
- Joachim Herz Stiftung (Add-On Fellowship for Interdisciplinary Sciences)
This publication has 94 references indexed in Scilit:
- Decision-making dynamics are predicted by arousal and uninstructed movementsCell Reports, 2024
- Expressions of emotions across speciesCurrent Opinion in Neurobiology, 2021
- Predictive models avoid excessive reductionism in cognitive neuroimagingCurrent Opinion in Neurobiology, 2019
- Decision-making behaviors: weighing ethology, complexity, and sensorimotor compatibilityCurrent Opinion in Neurobiology, 2018
- A Widely Applicable Real-Time Mono/Binocular Eye Tracking System Using a High Frame-Rate Digital Camera2017
- A circuit for pupil orienting responses: implications for cognitive modulation of pupil sizeCurrent Opinion in Neurobiology, 2015
- Facial expression recognition in rhesus monkeys, Macaca mulattaAnimal Behaviour, 2009
- The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistryPsychopharmacology, 2002
- On Cross-Validation for Predictor Evaluation in Time Series1988
- Mechanisms of visual attention revealed by saccadic eye movementsNeuropsychologia, 1987