E-Tree: An Efficient Indexing Structure for Ensemble Models on Data Streams
Authors:
- 1 February 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 27 (2) , 461-474
Abstract
Ensemble learning is a common tool for data stream classification, mainly because of its inherent advantages of handling large volumes of stream data and concept drifting. Previous studies, to date, have been primarily focused on building accurate ensemble models from stream data. However, a linear scan of a large number of base classifiers in the ensemble during prediction incurs significant costs in response time, preventing ensemble learning from being practical for many real-world time-critical data stream applications, such as Web traffic stream monitoring, spam detection, and intrusion detection. In these applications, data streams usually arrive at a speed of GB/second, and it is necessary to classify each stream record in a timely manner. To address this problem, we propose a novel Ensemble-tree (E-tree for short) indexing structure to organize all base classifiers in an ensemble for fast prediction. On one hand, E-trees treat ensembles as spatial databases and employ an R-tree like height-balanced structure to reduce the expected prediction time from linear to sub-linear complexity. On the other hand, E-trees can be automatically updated by continuously integrating new classifiers and discarding outdated ones, well adapting to new trends and patterns underneath data streams. Theoretical analysis and empirical studies on both synthetic and real-world data streams demonstrate the performance of our approach.Keywords
This publication has 37 references indexed in Scilit:
- Enabling Fast Lazy Learning for Data Streams2011
- The ClusTree: indexing micro-clusters for anytime stream miningKnowledge and Information Systems, 2010
- Indexing Boolean expressionsProceedings of the VLDB Endowment, 2009
- New ensemble methods for evolving data streams2009
- Scalable ranked publish/subscribeProceedings of the VLDB Endowment, 2008
- Near-optimal algorithms for shared filter evaluation in data stream systems2008
- StreaMon2004
- Similarity indexing with the SS-tree2002
- Incremental support vector machine construction2002
- Mining high-speed data streams2000