Web Traffic Anomaly Detection Using Isolation Forest
Authors:
- Wilson ChuaWCWilson Chua
- Arsenn Lorette Diamond PajasAPArsenn Lorette Diamond Pajas
- Crizelle Shane CastroCCCrizelle Shane Castro
- Sean Patrick PanganibanSPSean Patrick Panganiban
- April Joy PasuquinAPApril Joy Pasuquin
- Merwin Jan PurgananMPMerwin Jan Purganan
- Rica MalupengRMRica Malupeng
- Divine Jessa PingadDPDivine Jessa Pingad
- John Paul OrolfoJOJohn Paul Orolfo
- Haron Hakeen LuaHaron Hakeen Lua
- Lemuel Clark VelascoLVLemuel Clark Velasco
Open Access
- 5 November 2024
- journal article
- research article
- Published by MDPI AG in Informatics
- Vol. 11 (4) , 83
Abstract
As companies increasingly undergo digital transformation, the value of their data assets also rises, making them even more attractive targets for hackers. The large volume of weblogs warrants the use of advanced classification methodologies in order for cybersecurity specialists to identify web traffic anomalies. This study aims to implement Isolation Forest, an unsupervised machine learning methodology in the identification of anomalous and non-anomalous web traffic. The publicly available weblogs dataset from an e-commerce website underwent data preparation through a systematic pipeline of processes involving data ingestion, data type conversion, data cleaning, and normalization. This led to the addition of derived columns in the training set and manually labeled testing set that was then used to compare the anomaly detection performance of the Isolation Forest model with that of cybersecurity experts. The developed Isolation Forest model was implemented using the Python Scikit-learn library, and exhibited a superior Accuracy of 93%, Precision of 95%, Recall of 90% and F1-Score of 92%. By appropriate data preparation, model development, model implementation, and model evaluation, this study shows that Isolation Forest can be a viable solution for close to accurate web traffic anomaly detection.Keywords
Funding Information
- Mindanao State University-Iligan Institute of Technology
This publication has 30 references indexed in Scilit:
- A survey on imbalanced learning: latest research, applications and future directionsArtificial Intelligence Review, 2024
- Quality monitoring of real-time PPP service using isolation forest-based residual anomaly detectionGPS Solutions, 2024
- A Systematic and Comprehensive Study on Machine Learning and Deep Learning Models in Web Traffic PredictionArchives of Computational Methods in Engineering, 2024
- A comparative analysis of various machine learning methods for anomaly detection in cyber attacks on IoT networksInternet of Things, 2024
- Machine Learning for Anomaly Detection: A Systematic ReviewIEEE Access, 2021
- Intrusion Detection Based on Autoencoder and Isolation Forest in Fog ComputingIEEE Access, 2020
- An Enhanced Anomaly Detection in Web Traffic Using a Stack of Classifier EnsembleIEEE Access, 2020
- Web traffic anomaly detection using C-LSTM neural networksExpert Systems with Applications, 2018
- Enhanced Network Anomaly Detection Based on Deep Neural NetworksIEEE Access, 2018
- Malicious URI resolving in PDF documentsJournal of Computer Virology and Hacking Techniques, 2013