Performance-Based Comparative Assessment of Open Source Web Vulnerability Scanners
Open Access
- 1 January 2017
- journal article
- research article
- Published by Wiley in Security and Communication Networks
- Vol. 2017, 1-14
Abstract
The widespread adoption of web vulnerability scanners and the differences in the functionality provided by these tool-based vulnerability detection approaches increase the demand for testing their detection effectiveness. Despite the advantages of dynamic testing approaches, the literature lacks studies that systematically evaluate the performance of open source web vulnerability scanners. The main objectives of this study are to assess the performance of open source scanners from multiple perspectives and to examine their detection capability. This paper presents the results of a comparative evaluation of the security features as well as the performance of four web vulnerability detection tools. We followed this comparative assessment with a case study in which we evaluate the level of agreement between the results reported by two open source web vulnerability scanners. Given that the results of our comparative evaluation did not show significant performance differences among the scanners while the results of the conducted case study revealed high level of disagreement between the reports generated by different scanners, we conclude that the inconsistencies between the reports generated by different scanners might not necessarily correlate with their performance properties. We also present some recommendations for helping developers of web vulnerabilities scanners to improve their tools’ capabilities.Keywords
Funding Information
- NSTIP Strategic Technologies Program (11-INF1855-02)
- King Abdulaziz City for Science and Technology (11-INF1855-02)
This publication has 15 references indexed in Scilit:
- Analysis of Web Spam for Non-English Content: Toward More Effective Language-Based ClassifiersPLOS ONE, 2016
- On the capability of static code analysis to detect security vulnerabilitiesInformation and Software Technology, 2015
- Visualizing web server attacks: patterns in PHPIDS logs‡Security and Communication Networks, 2014
- Static analysis of source code security: Assessment of tools against SAMATE testsInformation and Software Technology, 2013
- Detecting Vulnerabilities in Web Applications Using Automated Black Box and Manual Penetration TestingCommunications in Computer and Information Science, 2013
- A systematic mapping study on the combination of static and dynamic quality assurance techniquesInformation and Software Technology, 2012
- Are Companies Actually Using Secure Development Life Cycles?Computer, 2010
- Why Johnny Can’t Pentest: An Analysis of Black-Box Web Vulnerability Scanners2010
- Testing Web-based applications: The state of the art and future trendsInformation and Software Technology, 2006
- Web application security assessment toolsIEEE Security & Privacy, 2006