Prototype Augmentation and Self-Supervision for Incremental Learning
Authors:
Top Cited Papers
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5867-5876
Abstract
Despite the impressive performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning new tasks incrementally. Recently, various incremental learning methods have been proposed, and some approaches achieved acceptable performance relying on stored data or complex generative models. However, storing data from previous tasks is limited by memory or privacy issues, and generative models are usually unstable and inefficient in training. In this paper, we propose a simple non-exemplar based method named PASS, to address the catastrophic forgetting problem in incremental learning. On the one hand, we propose to memorize one class-representative prototype for each old class and adopt prototype augmentation (protoAug) in the deep feature space to maintain the decision boundary of previous tasks. On the other hand, we employ self-supervised learning (SSL) to learn more generalizable and transferable features for other tasks, which demonstrates the effectiveness of SSL in incremental learning. Experimental results on benchmark datasets show that our approach significantly outperforms non-exemplar based methods, and achieves comparable performance compared to exemplar based approaches.Keywords
Funding Information
- National Natural Science Foundation of China
- Youth Innovation Promotion Association
This publication has 17 references indexed in Scilit:
- An Introduction to Variational AutoencodersFoundations and Trends in Machine Learning, 2019
- Learning a Unified Classifier Incrementally via Rebalancing2019
- Large Scale Incremental Learning2019
- Learning without ForgettingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- iCaRL: Incremental Classifier and Representation Learning2017
- Overcoming catastrophic forgetting in neural networksProceedings of the National Academy of Sciences of the United States of America, 2017
- Deep Residual Learning for Image Recognition2016
- Distance-Based Image Classification: Generalizing to New Classes at Near-Zero CostIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- ImageNet: A large-scale hierarchical image database2009
- Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem1989