Fast Anomaly Detection in Multiple Multi-Dimensional Data Streams
Authors:
- 1 December 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1218-1223
Abstract
Multiple multi-dimensional data streams are ubiquitous in the modern world, such as IoT applications, GIS applications and social networks. Detecting anomalies in such data streams in real-time is an important and challenging task. It is able to provide valuable information from data and then assists decision-making. However, exiting approaches for anomaly detection in multi-dimensional data streams have not properly considered the correlations among multiple multi-dimensional streams. Moreover, for multi-dimensional streaming data, online detection speed is often an important concern. In this paper, we propose a fast yet effective anomaly detection approach in multiple multi-dimensional data streams. This is based on a combination of ideas, i.e., stream pre-processing, locality sensitive hashing and dynamic isolation forest. Experiments on real datasets demonstrate that our approach achieves a magnitude increase in its efficiency compared with state-of-the-art approaches while maintaining competitive detection accuracy.Keywords
This publication has 19 references indexed in Scilit:
- A PCA-Based Change Detection Framework for Multidimensional Data Streams2015
- Outlier Detection for Temporal Data: A SurveyIEEE Transactions on Knowledge and Data Engineering, 2013
- Outlier ensemblesACM SIGKDD Explorations Newsletter, 2013
- Isolation-Based Anomaly DetectionACM Transactions on Knowledge Discovery From Data, 2012
- LSH based outlier detection and its application in distributed setting2011
- On Detecting Clustered Anomalies Using SCiForest2010
- Anomaly detectionACM Computing Surveys, 2009
- Angle-based outlier detection in high-dimensional data2008
- Cluster-based outlier detectionAnnals of Operations Research, 2008
- Efficient algorithms for mining outliers from large data setsACM SIGMOD Record, 2000