Knowledge discovery in data streams with regression tree methods
Authors:
- 31 October 2011
- journal article
- review article
- Published by Wiley in WIREs Data Mining and Knowledge Discovery
- Vol. 2 (1) , 69-78
Abstract
This paper presents an advanced review of regression tree methods for mining data streams. Batch regression tree methods are known for their simplicity, interpretability, accuracy, and efficiency. They use fast divide‐and‐conquer greedy algorithms that recursively partition the given training data into smaller subsets. The result is a tree‐shaped model with splitting rules in the internal nodes and predictions in the leaves. Most batch regression tree methods take a complete dataset and build a model using that data. Generally, this tree model cannot be modified if new data is acquired later. Their successors, the incremental model and interval trees algorithms, are able to build and retrain a model on a step‐by‐step basis by incorporating new numerical training instances into the model as they become available. Moreover, these algorithms produce even more compact and accurate models than batch regression tree algorithms because they use intervals or functional models with a change detection mechanism, which makes them a more suitable choice for regression analysis of data streams. Finally, this review summarizes the performance results of the reviewed methods and crystallizes 10 requirements for successful implementation of a regression tree algorithm in data stream mining area. © 2011 Wiley Periodicals, Inc.This article is categorized under: Algorithmic Development > Spatial and Temporal Data Mining Technologies > Machine Learning Technologies > PredictionKeywords
This publication has 38 references indexed in Scilit:
- Classification and regression treesWIREs Data Mining and Knowledge Discovery, 2011
- Learning model trees from evolving data streamsData Mining and Knowledge Discovery, 2010
- Top-down induction of model trees with regression and splitting nodesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Highest‐density forecast regions for nonlinear and non‐normal time series modelsJournal of Forecasting, 1995
- Multivariate Adaptive Regression SplinesThe Annals of Statistics, 1991
- On estimating probabilities in tree pruning1991
- Tree-Structured Classification via Generalized Discriminant AnalysisJournal of the American Statistical Association, 1988
- An Exploratory Technique for Investigating Large Quantities of Categorical DataJournal of the Royal Statistical Society Series C: Applied Statistics, 1980
- Problems in the Analysis of Survey Data, and a ProposalJournal of the American Statistical Association, 1963
- Tests of Equality Between Sets of Coefficients in Two Linear RegressionsEconometrica, 1960