Closing the Gap: A Comprehensive Benchmark of Static and Dynamic WebShell Detection Systems
Open Access
- 8 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 71418-71428
Abstract
With the proliferation of web technologies, web servers have become high-value targets for cyberattacks. A key attack vector involves the deployment of WebShells—malicious scripts that enable unauthorized remote access. Despite growing research on WebShell detection, most studies focus on novel methods and offer limited evaluations against existing open-source tools. To the best of our knowledge, this work presents the first systematic benchmarking and analysis of open-source WebShell detectors. We evaluate both static and dynamic detection tools using a dataset of 2,188 diverse PHPWebShells, examining tool performance across accuracy, false positives, and runtime efficiency. Furthermore, we propose a novel static detection approach that leverages Large Language Models (LLMs) to automatically generate regex-based detection rules. Our LLM-generated ruleset achieves the highest detection rate among all evaluated static methods at 92%, while maintaining an exceptionally low false positive rate of 0.49%. These results demonstrate the potential of LLMs as an effective aid in crafting high-quality detection signatures. Through our comprehensive evaluation, we provide actionable insights and recommendations tailored to real-world usage scenarios, empowering developers and security practitioners to select and build appropriate detection solutions based on practical constraints and goals.Keywords
This publication has 15 references indexed in Scilit:
- Handling webshell attacks: A systematic mapping and surveyComputers & Security, 2021
- Enhancing the Feature Profiles of Web Shells by Analyzing the Performance of Multiple Detectors2020
- WS-LSMR: Malicious WebShell Detection Algorithm Based on Ensemble LearningIEEE Access, 2020
- The rise of machine learning for detection and classification of malware: Research developments, trends and challengesJournal of Network and Computer Applications, 2020
- Webshell Detection Based on the Word Attention MechanismIEEE Access, 2019
- Webshell Traffic Detection With Character-Level Features Based on Deep LearningIEEE Access, 2018
- A Webshell Detection Technology Based on HTTP Traffic Analysis2018
- Webshell Detection Based on Random Forest–Gradient Boosting Decision Tree Algorithm2018
- Lexical Analysis for the Webshell Attacks2016
- No Honor Among Thieves2016