Comparing continual task learning in minds and machines
Authors:
Open Access
- 15 October 2018
- journal article
- research article
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 115 (44) , E10313-E10322
Abstract
Significance: Humans learn to perform many different tasks over the lifespan, such as speaking both French and Spanish. The brain has to represent task information without mutual interference. In machine learning, this “continual learning” is a major unsolved challenge. Here, we studied the patterns of errors made by humans and state-of-the-art neural networks while they learned new tasks from scratch and without instruction. Humans, but not machines, seem to benefit from training regimes that blocked one task at a time, especially when they had a prior bias to represent stimuli in a way that encouraged task separation. Machines trained to exhibit the same prior bias suffered less interference between tasks, suggesting new avenues for solving continual learning in artificial systems.Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- Representational geometry: integrating cognition, computation, and the brainTrends in Cognitive Sciences, 2013
- The importance of mixed selectivity in complex cognitive tasksNature, 2013
- Inverse MDS: Inferring Dissimilarity Structure from Multiple Item ArrangementsFrontiers in Psychology, 2012
- Bayesian model selection for group studiesNeuroImage, 2009
- Learning Concepts and CategoriesPsychological Science, 2008
- Representational similarity analysis – connecting the branches of systems neuroscienceFrontiers in Systems Neuroscience, 2008
- Knowledge Partitioning in Categorization: Constraints on Exemplar Models.Journal of Experimental Psychology: Learning, Memory, and Cognition, 2004
- Population of Linear Experts: Knowledge Partitioning and Function Learning.Psychological Review, 2004
- Catastrophic forgetting in connectionist networksTrends in Cognitive Sciences, 1999
- Contextual Interference Effects in Learning Three Badminton ServesResearch Quarterly for Exercise and Sport, 1986