Empirical Validation of Automated Vulnerability Curation and Characterization
- 28 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 49 (5) , 3241-3260
Abstract
Prior research has shown that public vulnerability systems such as US National Vulnerability Database (NVD) rely on a manual, time-consuming, and error-prone process which has led to inconsistencies and delays in releasing final vulnerability results. This work provides an approach to curate vulnerability reports in real-time and map textual vulnerability reports to machine readable structured vulnerability attribute data. Designed to support the time consuming human analysis done by vulnerability databases, the system leverages the Common Vulnerabilities and Exposures (CVE) list of vulnerabilities and the vulnerability attributes described by the National Institute of Standards and Technology (NIST) Vulnerability Description Ontology (VDO) framework. Our work uses Natural Language Processing (NLP), Machine Learning (ML) and novel Information Theoretical (IT) methods to provide automated techniques for near real-time publishing, and characterization of vulnerabilities using 28 attributes in 5 domains. Experiment results indicate that vulnerabilities can be evaluated up to 95 hours earlier than using manual methods, they can be characterized with F-Measure values over 0.9, and the proposed automated approach could save up to 47% of the time spent for CVE characterization.Keywords
Funding Information
- U.S. Department of Homeland Security (70RSAT19CB0000020)
This publication has 41 references indexed in Scilit:
- Detecting, Tracing, and Monitoring Architectural Tactics in CodeIEEE Transactions on Software Engineering, 2015
- An expert-based investigation of the Common Vulnerability Scoring SystemComputers & Security, 2015
- Developing an Ontology for Cyber Security Knowledge Graphs2015
- Have things changed now? An empirical study on input validation vulnerabilities in web applicationsComputers & Security, 2012
- An Empirical Study on Using the National Vulnerability Database to Predict Software Vulnerabilities2011
- Guidelines for conducting and reporting case study research in software engineeringEmpirical Software Engineering, 2008
- Decision Tree Instability and Active Learning2007
- Instability of decision tree classification algorithms2002
- Windows of vulnerability: a case study analysisComputer, 2000
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951