Complex Properties of Training Stimuli Affect Brain Alignment in a Deep Network Model of Mouse Visual Cortex
Authors:
Preprint
Abstract
Deep convolutional neural networks are important models of the visual cortex that ac-count relatively well for brain activity and are able to perform ethologically relevant functions. However, it is unknown which combination of factors, such as network ar-chitecture, training objectives, and data best align this family of models with the brain. Here we investigate the statistics of training data. We hypothesized that stimuli that are naturalistic for mice would lead to higher similarity between deep network models and activity in mouse visual cortex. We used a video-game engine to create training datasets in which we varied the naturalism of the environment, the movement statis-tics, and the optics of the modelled eye. The naturalistic environment substantially and consistently led to greater brain similarity, while the other factors had more subtle and area-specific effects. We then hypothesized that differences in brain similarity between the two environments arose due to differences in spatial frequency spectra, distribu-tions of color and orientation, and/or temporal autocorrelations. To test this, we created abstract environments, composed of cubes and spheres, that resembled the naturalis-tic and non-naturalistic environments in these respects. Contrary to our expectations, these factors accounted poorly for differences in brain similarity due to the naturalis-tic and non-naturalistic environments. This suggests that the higher brain similarities we observed after training with the naturalistic environment were due to more complex factors.Keywords
This publication has 27 references indexed in Scilit:
- Do Topographic Deep ANN Models of the Primate Ventral Stream Predict the Perceptual Effects of Direct IT Cortical Interventions?bioRxiv, 2024
- Deep problems with neural network models of human visionBehavioral and Brain Sciences, 2022
- Bio-inspired neural networks implement different recurrent visual processing strategies than task-trained ones dobioRxiv, 2022
- Survey of spiking in the mouse visual system reveals functional hierarchyNature, 2021
- Unsupervised neural network models of the ventral visual streamProceedings of the National Academy of Sciences of the United States of America, 2021
- Distributed and retinotopically asymmetric processing of coherent motion in mouse visual cortexNature Communications, 2020
- Principles for models of neural information processingNeuroImage, 2018
- Using goal-driven deep learning models to understand sensory cortexNature Neuroscience, 2016
- Experience-Dependent Specialization of Receptive Field Surround for Selective Coding of Natural ScenesNeuron, 2014
- Functional Specialization of Seven Mouse Visual Cortical AreasNeuron, 2011