Learning to Predict Gradients for Semi-Supervised Continual Learning
- 1 February 2025
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (2) , 2593-2607
Abstract
A key challenge for machine intelligence is to learn new visual concepts without forgetting the previously acquired knowledge. Continual learning (CL) is aimed toward addressing this challenge. However, there still exists a gap between CL and human learning. In particular, humans are able to continually learn from the samples associated with known or unknown labels in their daily lives, whereas existing CL and semi-supervised CL (SSCL) methods assume that the training samples are associated with known labels. Specifically, we are interested in two questions: 1) how to utilize unrelated unlabeled data for the SSCL task and 2) how unlabeled data affect learning and catastrophic forgetting in the CL task. To explore these issues, we formulate a new SSCL method, which can be generically applied to existing CL models. Furthermore, we propose a novel gradient learner to learn from labeled data to predict gradients on unlabeled data. In this way, the unlabeled data can fit into the supervised CL framework. We extensively evaluate the proposed method on mainstream CL methods, adversarial CL (ACL), and semi-supervised learning (SSL) tasks. The proposed method achieves state-of-the-art performance on classification accuracy and backward transfer (BWT) in the CL setting while achieving the desired performance on classification accuracy in the SSL setting. This implies that the unlabeled images can enhance the generalizability of CL models on the predictive ability of unseen data and significantly alleviate catastrophic forgetting. The code is available at https://github.com/luoyan407/grad_prediction.git.Keywords
All Related Versions
Funding Information
- NSF (1908711, 2143197)
- National Research Foundation, Singapore, under its Strategic Capability Research Centers Funding Initiative
This publication has 43 references indexed in Scilit:
- Class-Incremental Learning via Knowledge Amalgamation2023
- Learning a Unified Classifier Incrementally via Rebalancing2019
- Tangent-Normal Adversarial Regularization for Semi-Supervised Learning2019
- Large Scale Incremental Learning2019
- Memory Aware Synapses: Learning What (not) to Forget2018
- Deep Co-Training for Semi-Supervised Image Recognition2018
- iCaRL: Incremental Classifier and Representation Learning2017
- Overcoming catastrophic forgetting in neural networksProceedings of the National Academy of Sciences of the United States of America, 2017
- Deep Residual Learning for Image Recognition2016
- Large-Scale Machine Learning with Stochastic Gradient Descent2010