Time Series Forecasting of Software Vulnerabilities Using Statistical and Deep Learning Models
Open Access
- 7 September 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (18) , 2820
Abstract
Software security is a critical aspect of modern software products. The vulnerabilities that reside in their source code could become a major weakness for enterprises that build or utilize these products, as their exploitation could lead to devastating financial consequences. Therefore, the development of mechanisms capable of identifying and discovering software vulnerabilities has recently attracted the interest of the research community. Besides the studies that examine software attributes in order to predict the existence of vulnerabilities in software components, there are also studies that attempt to predict the future number of vulnerabilities based on the already reported vulnerabilities of a project. In this paper, the evolution of vulnerabilities in a horizon of up to 24 months ahead is predicted using a univariate time series forecasting approach. Both statistical and deep learning models are developed and compared based on security data coming from five popular software projects. In contrast to related literature, the results indicate that the capacity of Deep Learning and statistical models in forecasting the evolution of software vulnerabilities, as well as the selection of the best-performing model, depends on the respective software project. In some cases, statistical models provided better accuracy, whereas in other cases, Deep Learning models demonstrated better predictive power. However, the difference in their performance was not found to be statistically significant. In general, the two model categories produced similar forecasts for the number of vulnerabilities expected in the future, without significant diversities.Keywords
Funding Information
- European Commission (952684)
This publication has 38 references indexed in Scilit:
- Time series modeling of vulnerabilitiesComputers & Security, 2015
- Software vulnerability prediction using text analysis techniques2012
- Using complexity, coupling, and cohesion metrics as early indicators of vulnerabilitiesJournal of Systems Architecture, 2011
- On the bias of Croston’s forecasting methodEuropean Journal of Operational Research, 2009
- Modeling software evolution defects: a time series approachJournal of Software Maintenance and Evolution: Research and Practice, 2008
- Another look at measures of forecast accuracyInternational Journal of Forecasting, 2006
- The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem SolutionsInternational Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 1998
- Long Short-Term MemoryNeural Computation, 1997
- Forecasting and Stock Control for Intermittent DemandsJournal of the Operational Research Society, 1972
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945