Practically implementing an LLM-supported collaborative vulnerability remediation process: a team-based approach
Preprint
Abstract
Incorporating LLM into cybersecurity operations, a typical real-world high-stakes task, is critical but non-trivial in practice. Using cybersecurity as the study context, we conduct a three-step mix-method study to incorporate LLM into the vulnerability remediation process effectively. Specifically, we deconstruct the deficiencies in user satisfaction within the existing process (Study 1). This inspires us to design, implement, and empirically validate an LLM-supported collaborative vulnerability remediation process through a field study (Study 2). Given LLM's diverse contributions, we further investigate LLM's double-edge roles through the analysis of remediation reports and follow-up interviews (Study 3). In essence, our contribution lies in promoting an efficient LLM-supported collaborative vulnerability remediation process. These first-hand, real-world pieces of evidence suggest that when incorporating LLMs into practical processes, facilitating the collaborations among all associated stakeholders, reshaping LLMs' roles according to task complexity, as well as approaching the short-term side effects of improved user engagement facilitated by LLMs with a rational mindset.Keywords
All Related Versions
- Version 1, 2024-09-21, ArXiv
- Published version: Computers & Security, 148.
This publication has 49 references indexed in Scilit:
- Deep Reinforcement Learning in the Advanced Cybersecurity Threat Detection and ProtectionInformation Systems Frontiers, 2022
- A new DDoS attacks intrusion detection model based on deep learning for cybersecurityComputers & Security, 2022
- An exploratory examination of organizational insiders’ descriptive and normative perceptions of cyber-relevant rights and responsibilitiesComputers & Security, 2020
- DeNNeS: deep embedded neural network expert system for detecting cyber attacksNeural Computing and Applications, 2020
- The Utility of Information Security Training and Education on Cybersecurity Incidents: An empirical evidenceInformation Systems Frontiers, 2019
- Investigating the impact of cybersecurity policy awareness on employees’ cybersecurity behaviorInternational Journal of Information Management, 2019
- E-learning success determinants: Brazilian empirical studyComputers & Education, 2018
- A Practical Approach to Constructing a Knowledge Graph for CybersecurityEngineering, 2018
- What do help-seeking measures assess? Building a conceptualization framework for help-seeking intentions through a systematic review of measure contentClinical Psychology Review, 2018
- Unintended Consequences of Machine Learning in MedicineJAMA, 2017