An efficient and straightforward online vector quantization method for a data stream through remove-birth updating
Open Access
- 8 January 2024
- journal article
- research article
- Published by PeerJ in PeerJ Computer Science
- Vol. 10, e1789
Abstract
The growth of network-connected devices has led to an exponential increase in data generation, creating significant challenges for efficient data analysis. This data is generated continuously, creating a dynamic flow known as a data stream. The characteristics of a data stream may change dynamically, and this change is known as concept drift. Consequently, a method for handling data streams must efficiently reduce their volume while dynamically adapting to these changing characteristics. This article proposes a simple online vector quantization method for concept drift. The proposed method identifies and replaces units with low win probability through remove-birth updating, thus achieving a rapid adaptation to concept drift. Furthermore, the results of this study show that the proposed method can generate minimal dead units even in the presence of concept drift. This study also suggests that some metrics calculated from the proposed method will be helpful for drift detection.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Color reduction using a multi-stage Kohonen Self-Organizing Map with redundant featuresExpert Systems with Applications, 2011
- Following non-stationary distributions by controlling the vector quantization accuracy of a growing neural gas networkNeurocomputing, 2008
- Top 10 algorithms in data miningKnowledge and Information Systems, 2007
- IntroductionACM Transactions on Knowledge Discovery From Data, 2007
- A simple rule for the evolution of cooperation on graphs and social networksNature, 2006
- Self-organizing maps, vector quantization, and mixture modelingIEEE Transactions on Neural Networks, 2001
- Self-organizing maps for the skeletonization of sparse shapesIEEE Transactions on Neural Networks, 2000
- Chameleon: hierarchical clustering using dynamic modelingComputer, 1999
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982