Advanced Examination of User Behavior Recognition via Log Dataset Analysis of Web Applications Using Data Mining Techniques
Open Access
- 25 October 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 12 (21) , 4408
Abstract
As web systems based on containerization increasingly attract research interest, the need for effective analytical methods has heightened, with an emphasis on efficiency and cost reduction. Web client simulation tools have been utilized to further this aim. While applying machine learning (ML) methods for anomaly detection in requests is prevalent, predicting patterns in web datasets is still a complex task. Prior approaches incorporating elements such as URLs, content from web pages, and auxiliary features have not provided any satisfying results. Moreover, such methods have not significantly improved the understanding of client behavior and the variety of request types. To overcome these shortcomings, this study introduces an incremental approach to request categorization. This research involves an in-depth examination of various established classification techniques, assessing their performance on a selected dataset to determine the most effective model for classification tasks. The utilized dataset comprises 8 million distinct records, each defined by performance metrics. Upon conducting meticulous training and testing of multiple algorithms from the CART family, Extreme Gradient Boosting was deemed to be the best-performing model for classification tasks. This model outperforms prediction accuracy, even for unrecognized requests, reaching a remarkable accuracy of 97% across diverse datasets. These results underline the exceptional performance of Extreme Gradient Boosting against other ML techniques, providing substantial insights for efficient request categorization in web-based systems.Keywords
This publication has 21 references indexed in Scilit:
- Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural NetworksNeural Networks, 2021
- Providing Predictable Quality of Service in a Cloud-Based Web SystemApplied Sciences, 2021
- XGBoost2016
- Containers and Cloud: From LXC to Docker to KubernetesIEEE Cloud Computing, 2014
- Graph based anomaly detection and description: a surveyData Mining and Knowledge Discovery, 2014
- Advances and challenges in log analysisCommunications of the ACM, 2012
- Anomaly detectionACM Computing Surveys, 2009
- SEWeP2003
- SEWeP2003
- Web usage miningACM SIGKDD Explorations Newsletter, 2000