Unsupervised Alignment in Neuroscience: Introducing a Toolbox for Gromov-Wasserstein Optimal Transport
Authors:
Preprint
Abstract
Background: Understanding how sensory stimuli are represented across different brains, species, and artificial neural networks is a critical topic in neuroscience. Traditional methods for comparing these representations typically rely on supervised alignment, which assumes direct correspondence between stimuli representations across brains or models. However, it has limitations when this assumption is not valid, or when validating the assumption itself is the goal of the research. New method: To address the limitations of supervised alignment, we propose an unsupervised alignment method based on Gromov-Wasserstein optimal transport (GWOT). GWOT optimally identifies correspondences between representations by leveraging internal relationships without external labels, revealing intricate structural correspondences such as one-to-one, group-to-group, and shifted mappings. Results: We provide a comprehensive methodological guide and introduce a toolbox called GWTune for using GWOT in neuroscience. Our results show that GWOT can reveal detailed structural distinctions that supervised methods may overlook. We also demonstrate successful unsupervised alignment in key data domains, including behavioral data, neural activity recordings, and artificial neural network models, demonstrating its flexibility and broad applicability. Comparison with existing methods: Unlike traditional supervised alignment methods such as Representational Similarity Analysis, which assume direct correspondence between stimuli, GWOT provides a nuanced approach that can handle different types of structural correspondence, including fine-grained and coarse correspondences. Our method would provide richer insights into the similarity or difference of representations by revealing finer structural differences. Conclusion: We anticipate that our work will significantly broaden the accessibility and application of unsupervised alignment in neuroscience, offering novel perspectives on complex representational structures. By providing a user-friendly toolbox and a detailed tutorial, we aim to facilitate the adoption of unsupervised alignment techniques, enabling researchers to achieve a deeper understanding of cross-brain and cross-species representation analysis.Keywords
This publication has 33 references indexed in Scilit:
- A Task-Optimized Neural Network Replicates Human Auditory Behavior, Predicts Brain Responses, and Reveals a Cortical Processing HierarchyNeuron, 2018
- Deep Residual Learning for Image Recognition2016
- Population coding of affect across stimuli, modalities and individualsNature Neuroscience, 2014
- Performance-optimized hierarchical models predict neural responses in higher visual cortexProceedings of the National Academy of Sciences, 2014
- Representational geometry: integrating cognition, computation, and the brainTrends in Cognitive Sciences, 2013
- Human Object-Similarity Judgments Reflect and Transcend the Primate-IT Object RepresentationFrontiers in Psychology, 2013
- Gromov–Wasserstein Distances and the Metric Approach to Object MatchingFoundations of Computational Mathematics, 2011
- ImageNet: A large-scale hierarchical image database2009
- Matching Categorical Object Representations in Inferior Temporal Cortex of Man and MonkeyNeuron, 2008
- Procrustes Problems2004