Lifelong Online Learning from Accumulated Knowledge
Open Access
- 24 February 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 17 (4) , 1-23
Abstract
In this article, we formulate lifelong learning as an online transfer learning procedure over consecutive tasks, where learning a given task depends on the accumulated knowledge. We propose a novel theoretical principled framework, lifelong online learning, where the learning process for each task is in an incremental manner. Specifically, our framework is composed of two-level predictions: the prediction information that is solely from the current task; and the prediction from the knowledge base by previous tasks. Moreover, this article tackled several fundamental challenges: arbitrary or even non-stationary task generation process, an unknown number of instances in each task, and constructing an efficient accumulated knowledge base. Notably, we provide a provable bound of the proposed algorithm, which offers insights on the how the accumulated knowledge improves the predictions. Finally, empirical evaluations on both synthetic and real datasets validate the effectiveness of the proposed algorithm.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada (NSERC), Discovery Grants program, the Science and Technology Development Fund, Macau SAR (0045/2019/AFJ)
- University of Macau (MYRG2022-00197-FST)
This publication has 22 references indexed in Scilit:
- A personalized recommendation system with combinational algorithm for online learningJournal of Ambient Intelligence and Humanized Computing, 2017
- Introduction to Online Convex OptimizationFoundations and Trends® in Optimization, 2016
- Learning Cumulatively to Become More Knowledgeable2016
- A new iterative algorithm for solvingH∞control problem of continuous-time Markovian jumping linear systems based on online implementationInternational Journal of Robust and Nonlinear Control, 2016
- Smart Multitask Bregman Clustering and Multitask Kernel ClusteringACM Transactions on Knowledge Discovery From Data, 2015
- Online Transfer LearningArtificial Intelligence, 2014
- A Regularization Approach to Learning Task Relationships in Multitask LearningACM Transactions on Knowledge Discovery From Data, 2014
- Efficient online learning for multitask feature selectionACM Transactions on Knowledge Discovery From Data, 2013
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- Regularized multi--task learning2004