Pruning Incremental Linear Model Trees with Approximate Lookahead
Authors:
- 5 August 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 26 (8) , 2072-2076
Abstract
Incremental linear model trees with approximate lookahead are fast, but produce overly large trees. This is due to non-optimal splitting decisions boosted by a possibly unlimited number of examples obtained from a data source. To keep the processing speed high and the tree complexity low, appropriate incremental pruning techniques are needed. In this paper, we introduce a pruning technique for the class of incremental linear model trees with approximate lookahead on stationary data sources. Experimental results show that the advantage of approximate lookahead in terms of processing speed can be further improved by producing much smaller and consequently more explanatory, less memory consuming trees on high-dimensional data. This is done at the expense of only a small increase in prediction error. Additionally, the pruning algorithm can be tuned to either produce less accurate model trees at a much higher processing speed or, alternatively, more accurate trees at the expense of higher processing times.Keywords
This publication has 11 references indexed in Scilit:
- Knowledge discovery in data streams with regression tree methodsWIREs Data Mining and Knowledge Discovery, 2011
- Learning model trees from evolving data streamsData Mining and Knowledge Discovery, 2010
- Learning Model Trees from Data StreamsLecture Notes in Computer Science, 2008
- Incremental Learning of Linear Model TreesMachine Learning, 2005
- Mining high-speed data streams2000
- Simplifying decision treesInternational Journal of Man-Machine Studies, 1987
- Present Position and Potential Developments: Some Personal Views: Statistical Theory: The Prequential ApproachJournal of the Royal Statistical Society. Series A (General), 1984
- Tests of Equality Between Sets of Coefficients in Two Linear Regressions: An Expository NoteEconometrica, 1970
- Tests of Equality Between Sets of Coefficients in Two Linear RegressionsEconometrica, 1960
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945