Clustering over Multiple Evolving Streams by Events and Correlations
Authors:
- 17 September 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 19 (10) , 1349-1362
Abstract
In applications of multiple data streams such as stock market trading and sensor network data analysis, the clusters of streams change at different times because of data evolution. The information about evolving cluster is valuable to support corresponding online decisions. In this paper, we present a framework for clustering over multiple evolving streams by correlations and events, which, abbreviated as COMET-CORE, monitors the distribution of clusters over multiple data streams based on their correlation. Instead of directly clustering the multiple data streams periodically, COMET-CORE applies efficient cluster split and merge processes only when significant cluster evolution happens. Accordingly, we devise an event detection mechanism to signal the cluster adjustments. The coming streams are smoothed as sequences of end points by employing piecewise linear approximation. At the time when end points are generated, weighted correlations between streams are updated. End points are good indicators of significant change in streams, and this is a main cause of a cluster evolution event. When an event occurs, through split and merge operations we can report the latest clustering results. As shown in our experimental studies, COMET-CORE can be performed effectively with good clustering quality.Keywords
This publication has 24 references indexed in Scilit:
- Online clustering of parallel data streamsData & Knowledge Engineering, 2006
- ODAC: Hierarchical Clustering of Time Series Data Streams2006
- Density-Based Clustering over an Evolving Data Stream with Noise2006
- On High Dimensional Projected Clustering of Data StreamsData Mining and Knowledge Discovery, 2005
- Efficient k-NN Search on Streaming Data Series2003
- A Framework for Clustering Evolving Data Streams2003
- An online algorithm for segmenting time series2002
- DEMON: mining and monitoring evolving dataIEEE Transactions on Knowledge and Data Engineering, 2001
- Approximation by means of piecewise linear functionsResults in Mathematics, 1999
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987