A Systematic Literature Review on the Characteristics and Effectiveness of Web Application Vulnerability Scanners
Top Cited Papers
Open Access
- 22 March 2022
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 33200-33219
Abstract
Web applications have been a significant target for successful security breaches in the last few years. They are currently secured, as a primary method, by searching for their vulnerabilities with specialized tools referred to as Web Application Vulnerability Scanners (WVS’s). Although, these dynamic approaches of testing have some advantages, there is still a scarcity of studies that explore their features and detection capabilities in a systematic way. This article reports findings from a Systematic Literature Review (SLR) to look into the characteristics and effectiveness of the most frequently used WVS’s. A total of 90 research papers were carefully evaluated. Thirty (30) WVS’s were collected and reported, with only 12 having at least one quantitative assessment of effectiveness. These 12 WVS’s were evaluated by 15 original evaluation studies. We found that these evaluations tested mostly only two of the Open Web Application Security Project (OWASP) Top Ten vulnerability types: SQL injection (SQLi) (13/15) and Cross-Site Scripting (XSS) (8/15). Additionally, only one work evaluated six of the OWASP Top Ten vulnerability types and for only one scanner. We also found that the reported detection rates were highly dissimilar between these 15 evaluations. Based on these surprising results we suggest avenues for future directions.Keywords
Funding Information
- Majmaah University, Saudi Arabia
- University of Idaho, USA
This publication has 75 references indexed in Scilit:
- Evaluation of Web Security Mechanisms Using Vulnerability & Attack InjectionIEEE Transactions on Dependable and Secure Computing, 2014
- A survey on server-side approaches to securing web applicationsACM Computing Surveys, 2014
- Web Penetration Testing using Nessus and Metasploit ToolIOSR Journal of Computer Engineering, 2014
- WAPTT - Web Application Penetration Testing ToolAdvances in Electrical and Computer Engineering, 2014
- Using Vulnerability Injection to Improve Web Security2013
- Detecting Vulnerabilities in Web Applications Using Automated Black Box and Manual Penetration TestingCommunications in Computer and Information Science, 2013
- Experimentation and Validation of Web Application’s Vulnerability Using Security Testing Method2012
- Why Johnny Can’t Pentest: An Analysis of Black-Box Web Vulnerability Scanners2010
- The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaborationJournal of Clinical Epidemiology, 2009
- Leveraging User Interactions for In-Depth Testing of Web Applications2008