A comprehensive study on security bug characteristics
- 2 September 2021
- journal article
- research article
- Published by Wiley in Journal of Software: Evolution and Process
- Vol. 33 (10) , e2376
Abstract
Security bugs can catastrophically impact our increasingly digital lives. Designing effective tools for detecting and fixing software security bugs requires a deep understanding of security bug characteristics. In this paper, we conducted a comprehensive study on security bugs and proposed the classification criteria for security bug category, that is, root cause, consequence, and location. In addition, we selected 1076 bug reports from five projects (i.e., Apache Tomcat, Apache HTTP Server, Mozilla Firefox, Linux Kernel, and Eclipse) in the NVD for investigation. Finally, we investigated the correlation between the classification results and obtained some findings: (1) memory operation is the most common security bug; (2) the primary root causes of security bugs are CON (Configuration Error), INP (Input Validation Error), and MEM (Memory Error); (3) the severity of more than 40% of security bugs is high; (4) security bugs caused by INP mainly occur on web; and (5) security bugs caused by LOG (Logic Resource Error) usually lead to DoS (Denial of Service). We discussed these findings through data analysis, which can also help developers better understand the characteristics of security bugs.Keywords
Funding Information
- “333 Project” of Jiangsu Province
- National Natural Science Foundation of China (No. 61872312, No. 61972335, No. 62002309)
- Six Talent Peaks Project in Jiangsu Province (No. RJFW‐053)
This publication has 17 references indexed in Scilit:
- A novel approach for software vulnerability classification2017
- Cyber security analysis using vulnerability assessment and penetration testing2016
- Analysis and classification of SQL injection vulnerabilities and attacks on web applications2014
- Bug characteristics in open source softwareEmpirical Software Engineering, 2013
- Cohen’s kappa can always be increased and decreased by combining categoriesStatistical Methodology, 2010
- On a Classification Approach for SOA Vulnerabilities2009
- A software flaw taxonomyACM SIGSOFT Software Engineering Notes, 2005
- Sample-size calculations for Cohen's kappa.Psychological Methods, 1996
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960