Look twice: A generalist computational model predicts return fixations across tasks and species
Open Access
- 22 November 2022
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 18 (11) , e1010654
Abstract
Primates constantly explore their surroundings via saccadic eye movements that bring different parts of an image into high resolution. In addition to exploring new regions in the visual field, primates also make frequent return fixations, revisiting previously foveated locations. We systematically studied a total of 44,328 return fixations out of 217,440 fixations. Return fixations were ubiquitous across different behavioral tasks, in monkeys and humans, both when subjects viewed static images and when subjects performed natural behaviors. Return fixations locations were consistent across subjects, tended to occur within short temporal offsets, and typically followed a 180-degree turn in saccadic direction. To understand the origin of return fixations, we propose a proof-of-principle, biologically-inspired and image-computable neural network model. The model combines five key modules: an image feature extractor, bottom-up saliency cues, task-relevant visual features, finite inhibition-of-return, and saccade size constraints. Even though there are no free parameters that are fine-tuned for each specific task, species, or condition, the model produces fixation sequences resembling the universal properties of return fixations. These results provide initial steps towards a mechanistic understanding of the trade-off between rapid foveal recognition and the need to scrutinize previous fixation locations.Keywords
All Related Versions
Funding Information
- National Eye Institute (R01EY026025)
- NRF (AISG2-RP-2021-025)
- NSF Science and Technology Centers Award (CCF-1231216)
- CFAR Early Career Investigatorship
- Agency for Science, Technology and Research (C210415012)
- Research Foundation Flanders (FWO 1230521N)
This publication has 75 references indexed in Scilit:
- Active inhibition and memory promote exploration and search of natural scenesJournal of Vision, 2012
- Does oculomotor inhibition of return influence fixation probability during scene search?Attention, Perception, & Psychophysics, 2011
- The neural basis of visual attentionThe Journal of Physiology, 2010
- Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual CortexNeuron, 2009
- A theory of eye movements during target acquisition.Psychological Review, 2008
- A feedforward architecture accounts for rapid categorizationProceedings of the National Academy of Sciences, 2007
- Should I stay or should I go? How the human brain manages the trade-off between exploitation and explorationPhilosophical Transactions of the Royal Society B: Biological Sciences, 2007
- INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEMProgress in Neurobiology, 1997
- Memory Representations in Natural TasksJournal of Cognitive Neuroscience, 1995
- Short-term conceptual memory for pictures.Journal of Experimental Psychology: Human Learning and Memory, 1976