Transitions from monotonic to tuned responses in recurrent neural network models during timing prediction
Preprint
Abstract
The brain exhibits a gradual transition in responses to visual event duration and frequency through the visual processing hierarchy: from monotonically increasing to timing-tuned responses. Over their hierarchies, properties of both response types are progressively transformed. Here, we implement simulations based on artificial neural networks to investigate the requirements of neural systems for the emergence of such responses and their properties’ transformations. We see that recurrent networks develop monotonic responses whose properties’ progressions over network layers resemble those over brain areas. Responses to another sensory quantity, Furthermore, recurrent networks can further develop tuned responses, but only with training, a gradual transition between monotonic and tuned responses emerges. Particularly, if this training is done on predictable sequences, the tuned properties’ progressions resemble those observed in the brain. These results suggest that the emergence of visual timing-tuned responses and the subsequent hierarchical transformations of these responses result from recurrent neural computation and predictive processing of sensory event timing.Keywords
This publication has 39 references indexed in Scilit:
- Auditory timing-tuned neural responses in the human auditory corticesNeuroImage, 2022
- Numerosity tuning in human association cortices and local image contrast representations in early visual cortexNature Communications, 2022
- A Network of Topographic Maps in Human Association Cortex Hierarchically Transforms Visual Timing-Selective ResponsesCurrent Biology, 2020
- Numerical encoding in early visual cortexCortex, 2019
- Emergence of a 'visual number sense' in hierarchical generative modelsNature Neuroscience, 2012
- Interval time coding by neurons in the presupplementary and supplementary motor areasNature Neuroscience, 2009
- Learning multiple layers of representationTrends in Cognitive Sciences, 2007
- Storage capacity of non-monotonic neuronsNeural Networks, 1999
- Serial Order: A Parallel Distributed Processing Approach1997
- Local Synaptic Modification Can Lead to Organized Connectivity Patterns in Associative Memory1984