Comparative Analysis of Unsupervised Machine Learning Algorithms for Anomaly Detection in Network Data

Authors:

Abstract
The prevalence of cyberattacks has been increasing annually, emphasizing the need for data-driven approaches for the prevention and mitigation of attacks. Analysis of network data facilitates the acquisition of usage information, thereby enabling the detection of anomalous behavior that deviates from established patterns. The identification of such anomalies may indicate potential threats to the network and may assist security management systems in preempting and mitigating potential threats. The present study employs unsupervised machine learning algorithms with dimensionality reduction to detect anomalies in the NSL-KDD network dataset. The data is labeled although the real network datasets are unlabeled. We defined and applied a methodology to detect anomalies in the dataset. In the study, we used the following unsupervised algorithms: Local Outlier Factor (LOF), Elliptic Envelope (EE), SGD One Class SVM (SGD) and Isolation Forest (IF). For the kind of data we analysed, the unsupervised learning algorithm that obtained the highest AUC and F1-score evaluation rate was the Elliptic Envelope.
Funding Information
  • CAPES (426701/2018-6)
  • CNPq (436649/2018-7)