Efficient Anomaly Detection for High-Dimensional Sensing Data With One-Class Support Vector Machine
Authors:
- 3 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 35 (1) , 404-417
Abstract
This paper addresses the problem of anomaly detection for high-dimensional sensing data. The one-class support vector machine (OCSVM) is one of the most popular unsupervised methods for anomaly detection. When data are high dimensional and large scale, however, the efficiency of OCSVM-based methods in anomaly detection suffers. Although dimensionality-reduction tools, such as deep belief networks, can be applied to compress the high-dimensional data to alleviate the problem, the accuracy and timely detection are still hard to improve due to the inherent features of OCSVM. In this paper, we propose a new form of OCSVM model based on the structure of the compressed data and the characteristics of OCSVM. Based on the new model, we design both optimal and approximate methods for model training and testing. We evaluate the performance of our methods with extensive experiments on four real-world datasets. The experimental results demonstrate that our new methods, both optimal and approximate ones, not only significantly outperform the state-of-the-art in accuracy and efficiency, but also achieve the good performance without the need of manual parameter tuning. In addition, our approximate training and testing mechanism can reduce the computing time by three orders of magnitude with a negligible loss in accuracy.Keywords
Funding Information
- National Natural Science Foundation of China (31671589, 61402013, 61828202)
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2018-03896)
- Open Foundation of State Key Laboratory of Networking and Switching Technology (SKLNST-2018-1-10)
- Natural Science Foundation of Anhui Province (2008085MF203)
This publication has 22 references indexed in Scilit:
- Statistics-based outlier detection for wireless sensor networksInternational Journal of Geographical Information Science, 2012
- In-network outlier detection in wireless sensor networksKnowledge and Information Systems, 2012
- A Practical Guide to Training Restricted Boltzmann Machines2012
- Simple Random Sampling-Based Probe Station Selection for Fault Detection in Wireless Sensor NetworksSensors, 2011
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Intrusion Detection in Unlabeled Data with Quarter-sphere Support Vector MachinesPIK - Praxis der Informationsverarbeitung und Kommunikation, 2004
- Support Vector Data DescriptionMachine Learning, 2004
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- Comparing support vector machines with Gaussian kernels to radial basis function classifiersIEEE Transactions on Signal Processing, 1997