A Probabilistic Framework for Adapting to Changing and Recurring Concepts in Data Streams
Preprint
Abstract
The distribution of streaming data often changes over time as conditions change, a phenomenon known as concept drift. Only a subset of previous experience, collected in similar conditions, is relevant to learning an accurate classifier for current data. Learning from irrelevant experience describing a different concept can degrade performance. A system learning from streaming data must identify which recent experience is irrelevant when conditions change and which past experience is relevant when concepts reoccur, \textit{e.g.,} when weather events or financial patterns repeat. Existing streaming approaches either do not consider experience to change in relevance over time and thus cannot handle concept drift, or only consider the recency of experience and thus cannot handle recurring concepts, or only sparsely evaluate relevance and thus fail when concept drift is missed. To enable learning in changing conditions, we propose SELeCT, a probabilistic method for continuously evaluating the relevance of past experience. SELeCT maintains a distinct internal state for each concept, representing relevant experience with a unique classifier. We propose a Bayesian algorithm for estimating state relevance, combining the likelihood of drawing recent observations from a given state with a transition pattern prior based on the system's current state.Keywords
All Related Versions
- Version 1, 2024-08-18, ArXiv
- Published version: , 1.
This publication has 13 references indexed in Scilit:
- Recurring concept memory management in data streams: exploiting data stream concept evolution to improve performance and transparencyData Mining and Knowledge Discovery, 2021
- Continual lifelong learning with neural networks: A reviewNeural Networks, 2019
- Adapting dynamic classifier selection for concept driftExpert Systems with Applications, 2018
- A large-scale comparison of concept drift detectorsInformation Sciences, 2018
- Dynamic classifier selection: Recent advances and perspectivesInformation Fusion, 2018
- Ensemble learning for data stream analysis: A surveyInformation Fusion, 2017
- Modeling recurring concepts in data streams: a graph-based frameworkKnowledge and Information Systems, 2017
- Characterizing concept driftData Mining and Knowledge Discovery, 2016
- Predicting recurring concepts on data-streams by means of a meta-model and a fuzzy similarity functionExpert Systems with Applications, 2016
- Dynamic integration of classifiers for handling concept driftInformation Fusion, 2008