Do Developers Use Static Application Security Testing (SAST) Tools Straight Out of the Box? A large-scale Empirical Study
Open Access
- 24 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 454-460
Abstract
Static application Security Testing (SAST) tools are an established means of detecting vulnerabilities early in development. Previous studies have reported low detection rates from SAST tools and recommend either combining SAST tools or configuring rule sets to detect more vulnerabilities. However, while previous work suggests that developers rarely combine or configure any of the Automatic Static Analysis Tools (ASATs) they use, it is currently unclear whether SAST tools are used directly “out of the box”. To understand how developers use SAST tools, we performed a large-scale survey involving 1,263 developers. We pre-screened developers to establish their SAST use and found that only 20% (204/1,003) used SAST tools. Of those developers who did use SAST tools, we found a large number did not use multiple tools (59%), did not configure tools (54%) or did neither (40%). Our results suggest that more work is needed to help developers combine and configure tools, since doing so is likely to detect significantly more vulnerabilities.Keywords
This publication has 14 references indexed in Scilit:
- Do I really need all this work to find vulnerabilities?Empirical Software Engineering, 2022
- Let’s Talk With Developers, Not About Developers: A Review of Automatic Program Repair ResearchIEEE Transactions on Software Engineering, 2022
- How developers engage with static analysis tools in different contextsEmpirical Software Engineering, 2019
- Challenges with Responding to Static Analysis Tool Alerts2019
- An empirical study on combining diverse static analysis tools for web security vulnerabilities based on development scenariosComputing, 2018
- A Comparison of Open-Source Static Analysis Tools for Vulnerability Detection in C/C++ Code2017
- How Open Source Projects Use Static Code Analysis Tools in Continuous Integration Pipelines2017
- What developers want and need from program analysis: an empirical study2016
- Analyzing the State of Static Analysis: A Large-Scale Evaluation in Open Source Software2016
- Why don't software developers use static analysis tools to find bugs?2013