Enhancing network modularity to mitigate catastrophic forgetting
Authors:
Open Access
- 26 November 2020
- journal article
- research article
- Published by Springer Nature in Applied Network Science
- Vol. 5 (1) , 1-24
Abstract
Catastrophic forgetting occurs when learning algorithms change connections used to encode previously acquired skills to learn a new skill. Recently, a modular approach for neural networks was deemed necessary as learning problems grow in scale and complexity since it intuitively should reduce learning interference by separating functionality into physically distinct network modules. However, an algorithmic approach is difficult in practice since it involves expert design and trial and error. Kashtan et al. finds that evolution under an environment that changes in a modular fashion leads to the spontaneous evolution of a modular network structure. In this paper, we aim to solve the reverse problem of modularly varying goal (MVG) to obtain a highly modular structure that can mitigate catastrophic forgetting so that it can also apply to realistic data. First, we confirm that a configuration with a highly modular structure exists by applying an MVG against a realistic dataset and confirm that this neural network can mitigate catastrophic forgetting. Next, we solve the reverse problem, that is, we propose a method that can obtain a highly modular structure able to mitigate catastrophic forgetting. Since the MVG-obtained neural network can relatively maintain the intra-module elements while leaving the inter-module elements relatively variable, we propose a method to restrict the inter-module weight elements so that they can be relatively variable against the intra-module ones. From the results, the obtained neural network has a highly modular structure and can learn an unlearned goal faster than without this method.Keywords
Funding Information
- Japan Society for the Promotion of Science (19K20415)
This publication has 16 references indexed in Scilit:
- Neural Modularity Helps Organisms Evolve to Learn New Skills without Forgetting Old SkillsPLOS Computational Biology, 2015
- A survey of recent advances in visual feature detectionNeurocomputing, 2015
- The evolutionary origins of modularityProceedings Of The Royal Society B-Biological Sciences, 2013
- An Analytically Solvable Model for Rapid Evolution of Modular StructurePLOS Computational Biology, 2009
- Facilitated Variation: How Evolution Learns from Past Environments To Generalize to New EnvironmentsPLOS Computational Biology, 2008
- Fast unfolding of communities in large networksJournal of Statistical Mechanics: Theory and Experiment, 2008
- Varying environments can speed up evolutionProceedings of the National Academy of Sciences, 2007
- Modularity and community structure in networksProceedings of the National Academy of Sciences, 2006
- Spontaneous evolution of modularity and network motifsProceedings of the National Academy of Sciences, 2005
- Catastrophic forgetting in connectionist networksTrends in Cognitive Sciences, 1999