An embedding approach to anomaly detection
Authors:
- 1 May 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 385-396
Abstract
Network anomaly detection has become very popular in recent years because of the importance of discovering key regions of structural inconsistency in the network. In addition to application-specific information carried by anomalies, the presence of such structural inconsistency is often an impediment to the effective application of data mining algorithms such as community detection and classification. In this paper, we study the problem of detecting structurally inconsistent nodes that connect to a number of diverse influential communities in large social networks. We show that the use of a network embedding approach, together with a novel dimension reduction technique, is an effective tool to discover such structural inconsistencies. We also experimentally show that the detection of such anomalous nodes has significant applications: one is the specific use of detected anomalies, and the other is the improvement of the effectiveness of community detection.Keywords
This publication has 27 references indexed in Scilit:
- Non-Negative Residual Matrix Factorization with Application to Graph Anomaly Detection2011
- Benchmark graphs for testing community detection algorithmsPhysical Review E, 2008
- A tutorial on spectral clusteringStatistics and Computing, 2007
- Finding community structure in very large networksPhysical Review E, 2004
- Structural Holes and Good IdeasAmerican Journal of Sociology, 2004
- A faster algorithm for betweenness centrality*The Journal of Mathematical Sociology, 2001
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- A Fast and High Quality Multilevel Scheme for Partitioning Irregular GraphsSIAM Journal on Scientific Computing, 1998
- Minimization of functions having Lipschitz continuous first partial derivativesPacific Journal of Mathematics, 1966