A Framework for Clustering Categorical Time-Evolving Data
Authors:
- 20 May 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 18 (5) , 872-882
Abstract
A fundamental assumption often made in unsupervised learning is that the problem is static, i.e., the description of the classes does not change with time. However, many practical clustering tasks involve changing environments. It is hence recognized that the methods and techniques to analyze the evolving trends for changing environments are of increasing interest and importance. Although the problem of clustering numerical time-evolving data is well-explored, the problem of clustering categorical time-evolving data remains as a challenging issue. In this paper, we propose a generalized clustering framework for categorical time-evolving data, which is composed of three algorithms: a drifting-concept detecting algorithm that detects the difference between the current sliding window and the last sliding window, a data-labeling algorithm that decides the most-appropriate cluster label for each object of the current sliding window based on the clustering results of the last sliding window, and a cluster-relationship-analysis algorithm that analyzes the relationship between clustering results at different time stamps. The time-complexity analysis indicates that these proposed algorithms are effective for large datasets. Experiments on a real dataset show that the proposed framework not only accurately detects the drifting concepts but also attains clustering results of better quality. Furthermore, compared with the other framework, the proposed one needs fewer parameters, which is favorable for specific applications.Keywords
This publication has 30 references indexed in Scilit:
- A new initialization method for categorical data clusteringExpert Systems with Applications, 2009
- Catching the Trend: A Framework for Clustering Concept-Drifting Categorical DataIEEE Transactions on Knowledge and Data Engineering, 2008
- A Web Usage Mining Framework for Mining Evolving User Profiles in Dynamic Web SitesIEEE Transactions on Knowledge and Data Engineering, 2007
- Clustering over Multiple Evolving Streams by Events and CorrelationsIEEE Transactions on Knowledge and Data Engineering, 2007
- A Framework for Projected Clustering of High Dimensional Data Streams2004
- Streaming-data algorithms for high-quality clustering2003
- Clustering data streams2002
- Some new indexes of cluster validityIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1998
- On cluster validity for the fuzzy c-means modelIEEE Transactions on Fuzzy Systems, 1995
- Rough setsInternational Journal of Parallel Programming, 1982