Unveiling Network Anomalies: A Comparative Study of Real-time Log-Based Detection Approach
Authors:
- 14 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1216-1221
Abstract
In this paper, we address the issue of detecting anomalies in network log files. In laboratory setup, log files are generated by network devices such as routers, switches, firewalls, and servers. These log files contain information about network activities, such as network traffic, device configurations, user activity, and security events. Analyzing log files on computer networks is essential for identifying potential security threats and network issues. Researchers have sought to develop quick and effective methods to identify anomalies in a computer system by examining its log data as a result of this significant utility. In our work, we have used a machine-learning approach called Isolation Forest (iForest) and also examined clustering algorithms, Ordering Points To Identify Cluster Structure, referred to as OPTICS Clustering, and the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm, for detecting anomalies in real-time log datasets. The performance of each model is evaluated and compared. Finally, we conclude by presenting the experimental results that demonstrate the effectiveness of the suggested method and future directions in real-time log-based anomaly detection, highlighting the need for more advanced and efficient methods to deal with the increasing complexity and scale of modern networks.Keywords
This publication has 10 references indexed in Scilit:
- Threshold based Technique to Detect Anomalies using Log Files2022
- Detecting anomalies in business process event logs using statistical leverageInformation Sciences, 2021
- LogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs2019
- Log-Based Anomaly Detection of CPS Using a Statistical Method2017
- Experience Report: System Log Analysis for Anomaly Detection2016
- Outlier Detection in Arbitrarily Oriented Subspaces2012
- HiCS: High Contrast Subspaces for Density-Based Outlier Ranking2012
- A Lightweight Algorithm for Message Type Extraction in System Application LogsIEEE Transactions on Knowledge and Data Engineering, 2011
- Isolation Forest2008
- OPTICSACM SIGMOD Record, 1999