Deep VULMAN: A Deep Reinforcement Learning-Enabled Cyber Vulnerability Management Framework
Preprint
Abstract
Cyber vulnerability management is a critical function of a cybersecurity operations center (CSOC) that helps protect organizations against cyber-attacks on their computer and network systems. Adversaries hold an asymmetric advantage over the CSOC, as the number of deficiencies in these systems is increasing at a significantly higher rate compared to the expansion rate of the security teams to mitigate them in a resource-constrained environment. The current approaches are deterministic and one-time decision-making methods, which do not consider future uncertainties when prioritizing and selecting vulnerabilities for mitigation. These approaches are also constrained by the sub-optimal distribution of resources, providing no flexibility to adjust their response to fluctuations in vulnerability arrivals. We propose a novel framework, Deep VULMAN, consisting of a deep reinforcement learning agent and an integer programming method to fill this gap in the cyber vulnerability management process. Our sequential decision-making framework, first, determines the near-optimal amount of resources to be allocated for mitigation under uncertainty for a given system state and then determines the optimal set of prioritized vulnerability instances for mitigation. Our proposed framework outperforms the current methods in prioritizing the selection of important organization-specific vulnerabilities, on both simulated and real-world vulnerability data, observed over a one-year period.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Towards Optimal Triage and Mitigation of Context-Sensitive Cyber VulnerabilitiesIEEE Transactions on Dependable and Secure Computing, 2022
- A Reinforcement Learning Approach for Rebalancing Electric Vehicle Sharing SystemsIEEE Transactions on Intelligent Transportation Systems, 2021
- Challenges of real-world reinforcement learning: definitions, benchmarks and analysisMachine Learning, 2021
- Learning Humanoid Robot Running Skills through Proximal Policy Optimization2019
- Vulnerability Selection for Remediation: An Empirical AnalysisThe Journal of Defense Modeling and Simulation: Applications, Methodology, Technology, 2019
- A Two-Step Approach to Optimal Selection of Alerts for Investigation in a CSOCIEEE Transactions on Information Forensics and Security, 2018
- Modeling and Predicting Cyber Hacking BreachesIEEE Transactions on Information Forensics and Security, 2018
- Comparing Vulnerability Severity and Exploits Using Case-Control StudiesACM Transactions on Information and System Security, 2014
- Empirical Analysis of System-Level Vulnerability Metrics through Actual AttacksIEEE Transactions on Dependable and Secure Computing, 2012
- Common Vulnerability Scoring SystemIEEE Security & Privacy, 2006