Xtreaming: an incremental multidimensional projection technique and its application to streaming data
Preprint
Abstract
Streaming data applications are becoming more common due to the ability of different information sources to continuously capture or produce data, such as sensors and social media. Despite recent advances, most visualization approaches, in particular, multidimensional projection or dimensionality reduction techniques, cannot be directly applied in such scenarios due to the transient nature of streaming data. Currently, only a few methods address this limitation using online or incremental strategies, continuously processing data, and updating the visualization. Despite their relative success, most of them impose the need for storing and accessing the data multiple times, not being appropriate for streaming where data continuously grow. Others do not impose such requirements but are not capable of updating the position of the data already projected, potentially resulting in visual artifacts. In this paper, we present Xtreaming, a novel incremental projection technique that continuously updates the visual representation to reflect new emerging structures or patterns without visiting the multidimensional data more than once. Our tests show that Xtreaming is competitive in terms of global distance preservation if compared to other streaming and incremental techniques, but it is orders of magnitude faster. To the best of our knowledge, it is the first methodology that is capable of evolving a projection to faithfully represent new emerging structures without the need to store all data, providing reliable results for efficiently and effectively projecting streaming data.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- LoCH: A neighborhood-based multidimensional projection technique for high-dimensional sparse spacesNeurocomputing, 2015
- A survey on learning from data streams: current and future trendsProgress in Artificial Intelligence, 2012
- Real-Time Environmental Monitoring and Notification for Public SafetyIEEE MultiMedia, 2010
- Processing of massive audit data streams for real-time anomaly intrusion detectionComputer Communications, 2008
- Incremental Learning for Robust Visual TrackingInternational Journal of Computer Vision, 2007
- A scalable supervised algorithm for dimensionality reduction on streaming data☆Information Sciences, 2006
- Incremental locally linear embeddingPattern Recognition, 2005
- Sequential Karhunen-Loeve basis extraction and its application to imagesIEEE Transactions on Image Processing, 2000
- Argumentative Text as Rhetorical Structure: An Application of Rhetorical Structure TheoryArgumentation, 1999
- A Nonlinear Mapping for Data Structure AnalysisIEEE Transactions on Computers, 1969