PROMPT-BART: A Named Entity Recognition Model Applied to Cyber Threat Intelligence
Open Access
- 22 September 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (18) , 10276
Abstract
The growing sophistication of cyberattacks underscores the need for the automated extraction of machine-readable intelligence from unstructured Cyber Threat Intelligence (CTI), commonly achieved through Named Entity Recognition (NER). However, existing CTI-oriented NER research faces two major limitations: the scarcity of standardized datasets and the lack of advanced models tailored to domain-specific entities. To address the dataset challenge, we present CTINER, the first STIX 2.1-aligned dataset, comprising 42,549 annotated entities across 13 cybersecurity-specific types. CTINER surpasses existing resources in both scale (+51.82% more annotated entities) and vocabulary coverage (+40.39%), while ensuring label consistency and rationality. To tackle the modeling challenge, we propose PROMPT-BART, a novel NER model built upon the BART generative framework and enhanced through three types of prompt designs. Experimental results show that PROMPT-BART improves F1 scores by 4.26–8.3% over conventional deep learning baselines and outperforms prompt-based baselines by 1.31%.Keywords
All Related Versions
Funding Information
- Open Foundation of the Key Laboratory of Cyberspace Security, Ministry of Education of China (KLCS20240206)
This publication has 32 references indexed in Scilit:
- MPE: Learning meta-prompt with entity-enhanced semantics for few-shot named entity recognitionNeurocomputing, 2024
- Combating Advanced Persistent Threats: Challenges and SolutionsIEEE Network, 2024
- Order-Agnostic Data Augmentation for Few-Shot Named Entity Recognition2024
- Enhancing Cyber Threat Intelligence with Named Entity Recognition Using BERT-CRF2023
- Cyber-threat intelligence for security decision-making: A review and research agenda for practiceComputers & Security, 2023
- PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen DomainsTransactions of the Association for Computational Linguistics, 2022
- TriCTI: an actionable cyber threat intelligence discovery system via trigger-enhanced neural networkCybersecurity, 2022
- Named Entity Recognition by Using XLNet-BiLSTM-CRFNeural Processing Letters, 2021
- Automatic extraction of named entities of cyber threats using a deep Bi-LSTM-CRF networkInternational Journal of Machine Learning and Cybernetics, 2020
- Results of the WNUT2017 Shared Task on Novel and Emerging Entity Recognition2017