Flexible multitask computation in recurrent networks utilizes shared dynamical motifs
Top Cited Papers
Open Access
- 9 July 2024
- journal article
- research article
- Published by Springer Nature in Nature Neuroscience
- Vol. 27 (7) , 1349-1363
Abstract
Flexible computation is a hallmark of intelligent behavior. However, little is known about how neural networks contextually reconfigure for different computations. In the present work, we identified an algorithmic neural substrate for modular computation through the study of multitasking artificial recurrent neural networks. Dynamical systems analyses revealed learned computational strategies mirroring the modular subtask structure of the training task set. Dynamical motifs, which are recurring patterns of neural activity that implement specific computations through dynamics, such as attractors, decision boundaries and rotations, were reused across tasks. For example, tasks requiring memory of a continuous circular variable repurposed the same ring attractor. We showed that dynamical motifs were implemented by clusters of units when the unit activation function was restricted to be positive. Cluster lesions caused modular performance deficits. Motifs were reconfigured for fast transfer learning after an initial phase of learning. This work establishes dynamical motifs as a fundamental unit of compositional computation, intermediate between neuron and network. As whole-brain studies simultaneously record activity from multiple specialized systems, the dynamical motif framework will guide questions about specialization and generalization.Keywords
Funding Information
- Simons Foundation (543045, 1155867, 543049, 543045, 543049)
This publication has 58 references indexed in Scilit:
- Recurrent networks endowed with structural priors explain suboptimal animal behaviorCurrent Biology, 2023
- Codimension-2 parameter space structure of continuous-time recurrent neural networksBiological Cybernetics, 2022
- Modularity and robustness of frontal cortical networksCell, 2021
- Pre-trained models: Past, present and futureAI Open, 2021
- Hand Knob Area of Premotor Cortex Represents the Whole Body in a Compositional WayCell, 2020
- How to study the neural mechanisms of multiple tasksCurrent Opinion in Behavioral Sciences, 2019
- Flexible Sensorimotor Computations through Rapid Reconfiguration of Cortical DynamicsNeuron, 2018
- Motor Cortex Embeds Muscle-like Commands in an Untangled Population ResponseNeuron, 2018
- Computational models in the age of large datasetsCurrent Opinion in Neurobiology, 2015
- Dynamic Control of Response Criterion in Premotor Cortex during Perceptual Detection under Temporal UncertaintyNeuron, 2015