Automated vulnerability evaluation with large language models and vulnerability ontologies
Authors:
Open Access
- 15 September 2025
- journal article
- Published by Wiley in AI Magazine
- Vol. 46 (3)
Abstract
The National Vulnerability Database (NVD) publishes over a thousand new vulnerabilities monthly, with a projected 25 percent increase in 2024, highlighting the crucial need for rapid vulnerability identification to mitigate cybersecurity attacks and save costs and resources. In this work, we propose using large language models (LLMs) to learn vulnerability evaluation from historical assessments of medical device vulnerabilities in a single manufacturer's portfolio. We highlight the effectiveness and challenges of using LLMs for automatic vulnerability evaluation and introduce a method to enrich historical data with cybersecurity ontologies, enabling the system to understand new vulnerabilities without retraining the LLM. Our LLM system integrates with the in‐house application—Cybersecurity Management System (CSMS)—to help Siemens Healthineers (SHS) product cybersecurity experts efficiently assess the vulnerabilities in our products. Also, we present a comprehensive set of experiments that helps showcase the properties of the LLM and dataset, the various guardrails we have implemented to safeguard the system in production, and the guidelines for efficient integration of LLMs into the cybersecurity tool.Keywords
This publication has 22 references indexed in Scilit:
- PLLM-CS: Pre-trained Large Language Model (LLM) for cyber threat detection in satellite networksAd Hoc Networks, 2024
- Large language models for automated Q&A involving legal documents: a survey on algorithms, frameworks and applicationsInternational Journal of Web Information Systems, 2024
- CVSS Base Score Prediction Using an Optimized Machine Learning Scheme2023
- SMET: Semantic Mapping of CVE to ATT&CK and Its Application to Cybersecurity2023
- CVSS-BERT: Explainable Natural Language Processing to Determine the Severity of a Computer Security Vulnerability from its Description2021
- Predicting Vulnerability Type in Common Vulnerabilities and Exposures (CVE) Database with Machine Learning Classifiers2021
- Apply transfer learning to cybersecurity: Predicting exploitability of vulnerabilities by descriptionKnowledge-Based Systems, 2020
- The SEPSES Knowledge Graph: An Integrated Resource for Cybersecurity2019
- Developing an Ontology for Cyber Security Knowledge Graphs2015
- Common Vulnerability Scoring SystemIEEE Security & Privacy, 2006