Towards More Practical Automation of Vulnerability Assessment
Open Access
- 12 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Abstract
It is increasingly suggested to identify emerging software vulnerabilities (SVs) through relevant development activities (e.g., issue reports) to allow early warnings to open source software (OSS) users. However, the support for the following assessment of the detected SVs has not yet been explored. SV assessment characterizes the detected SVs to prioritize limited remediation resources on the critical ones. To fill this gap, we aim to enable early vulnerability assessment based on SV-related issue reports (SIR). Besides, we observe the following concerns of the existing assessment techniques: 1) the assessment output lacks rationale and practical value; 2) the associations between Common Vulnerability Scoring System (CVSS) metrics have been ignored; 3) insufficient evaluation scenarios and metrics. We address these concerns to enhance the practicality of our proposed early vulnerability assessment approach (namely proEVA). Specifically, based on the observation of strong associations between CVSS metrics, we propose a prompt-based model to exploit such relations for CVSS metrics prediction. Moreover, we design a curriculum-learning (CL) schedule to guide the model better learn such hidden associations during training. Aside from the standard classification metrics adopted in existing works, we propose two severity-aware metrics to provide a more comprehensive evaluation regarding the prioritization of the high-severe SVs. Experimental results show that proEVA significantly outperforms the baselines in both types of metrics. We further discuss the transferability of the prediction model regarding the upgrade of the assessment system, an important yet overlooked evaluation scenario in existing works. The results verify that proEVA is more efficient and flexible in migrating to different assessment systems.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFB2701102)
- National Science Foundation of China (62372398, 62141222, U20A20173)
- Fundamental Research Funds for the Central Universities (226-2022-00064)
This publication has 37 references indexed in Scilit:
- DeepCVA: Automated Commit-level Vulnerability Assessment with Deep Multi-task Learning2021
- On the need of preserving order of data when validating within-project defect classifiersEmpirical Software Engineering, 2020
- Improving the Accuracy of Vulnerability Report Classification Using Term Frequency-Inverse Gravity Moment2019
- Intelligent Prediction of Vulnerability Severity Level Based on Text Mining and XGBboost2019
- A multi-target approach to estimate software vulnerability characteristics and severity scoresJournal of Systems and Software, 2018
- Learning to Predict Severity of Software Vulnerability Using Only Vulnerability Description2017
- Text-Mining Approach for Estimating Vulnerability Score2015
- VRSS: A new system for rating and scoring vulnerabilitiesComputer Communications, 2011
- Revisiting common bug prediction findings using effort-aware models2010
- Effort-Aware Defect Prediction Models2010