Unsupervised Anomaly Detectors to Detect Intrusions in the Current Threat Landscape
Authors:
Open Access
- 8 April 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM/IMS Transactions on Data Science
- Vol. 2 (2) , 1-26
Abstract
Anomaly detection aims at identifying unexpected fluctuations in the expected behavior of a given system. It is acknowledged as a reliable answer to the identification of zero-day attacks to such extent, several ML algorithms that suit for binary classification have been proposed throughout years. However, the experimental comparison of a wide pool of unsupervised algorithms for anomaly-based intrusion detection against a comprehensive set of attacks datasets was not investigated yet. To fill such gap, we exercise 17 unsupervised anomaly detection algorithms on 11 attack datasets. Results allow elaborating on a wide range of arguments, from the behavior of the individual algorithm to the suitability of the datasets to anomaly detection. We conclude that algorithms as Isolation Forests, One-Class Support Vector Machines, and Self-Organizing Maps are more effective than their counterparts for intrusion detection, while clustering algorithms represent a good alternative due to their low computational complexity. Further, we detail how attacks with unstable, distributed, or non-repeatable behavior such as Fuzzing, Worms, and Botnets are more difficult to detect. Ultimately, we digress on capabilities of algorithms in detecting anomalies generated by a wide pool of unknown attacks, showing that achieved metric scores do not vary with respect to identifying single attacks.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- An experimental evaluation of novelty detection methodsNeurocomputing, 2014
- Toward developing a systematic approach to generate benchmark datasets for intrusion detectionComputers & Security, 2012
- Unsupervised Network Intrusion Detection Systems: Detecting the Unknown without KnowledgeComputer Communications, 2012
- Anomaly detectionACM Computing Surveys, 2009
- On learning algorithm selection for classificationApplied Soft Computing, 2006
- An intelligent intrusion detection system (IDS) for anomaly and misuse detection in computer networksExpert Systems with Applications, 2005
- A taxonomy of DDoS attack and DDoS defense mechanismsACM SIGCOMM Computer Communication Review, 2004
- Intrusion detection techniques and approachesComputer Communications, 2002
- Maximum likelihood classification, optimal or problematic? A comparison with the nearest neighbour classificationInternational Journal of Remote Sensing, 1987
- Algorithm AS 136: A K-Means Clustering AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979