Universality of representation in biological and artificial neural networks
Preprint
Abstract
Many artificial neural networks (ANNs) trained with ecologically plausible objectives on naturalistic data align with behavior and neural representations in biological systems. Here, we show that this alignment is a consequence of convergence onto the same representations by high-performing ANNs and by brains. We developed a method to identify stimuli that systematically vary the degree of inter-model representation agreement. Across language and vision, we then showed that stimuli from high-and low-agreement sets predictably modulated model-to-brain alignment. We also examined which stimulus features distinguish high-from low-agreement sentences and images. Our results establish representation universality as a core component in the model-to-brain alignment and provide a new approach for using ANNs to uncover the structure of biological representations and computations.Keywords
This publication has 115 references indexed in Scilit:
- Explanatory models in neuroscience, Part 2: Functional intelligibility and the contravariance principleCognitive Systems Research, 2023
- Testing methods of neural systems understandingCognitive Systems Research, 2023
- Effects of negative emotional valence on readers’ text processing and memory for text: an eye-tracking studyReading and Writing, 2022
- Predicting individual neuron responses with anatomically constrained task optimizationCurrent Biology, 2021
- Lack of selectivity for syntax relative to word meanings throughout the language networkCognition, 2020
- Evolving understanding of nervous system evolutionCurrent Biology, 2016
- Parallel Computations in Insect and Mammalian Visual Motion ProcessingCurrent Biology, 2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Data from eye-tracking corpora as evidence for theories of syntactic processing complexityCognition, 2008
- Spatial registration and normalization of imagesHuman Brain Mapping, 1995