A Novel Threat Intelligence Information Extraction System Combining Multiple Models
Open Access
- 9 December 2022
- journal article
- research article
- Published by Wiley in Security and Communication Networks
- Vol. 2022, 1-12
Abstract
The increasing number of cyberattacks has made the cybersecurity situation more serious. Thus, it is urgent to use cyber threat intelligence to deal with the complex and changing cyber environment. However, cyber threat intelligence usually exists in an unstructured form, and a huge amount of data poses a great challenge to security analysts. To this end, this paper proposes a novel threat intelligence information extraction system combining multiple models, which contains four key steps: entity extraction, coreference resolution, relation extraction, and knowledge graph construction. In the entity extraction task, a multihead self-attention mechanism is adopted to extract the dependency relationships between words. In the coreference resolution task, contextual information and mention embedding are fused to improve the mention representation. Meanwhile, features of different dimensions are extracted using a convolutional neural network. In the relation extraction task, additional features such as part of speech, mention width, entity type, and distance of entity pairs are incorporated to improve the embedding representation. Finally, a knowledge graph is constructed to explicitly present entities and their relationships. Experimental results indicate that compared with the baseline model, the F1 score of our model is improved by at least 8.87, 9.82, and 10.56 on entity extraction, coreference resolution, and relation extraction, respectively. The knowledge graph in Neo4j demonstrates the effectiveness of our system.Keywords
Funding Information
- National Natural Science Foundation of China (61501515, 61601515)
This publication has 12 references indexed in Scilit:
- A distributed intrusion detection system to detect DDoS attacks in blockchain-enabled IoT networkJournal of Parallel and Distributed Computing, 2022
- End-to-end neural event coreference resolutionArtificial Intelligence, 2022
- CTI View: APT Threat Intelligence Analysis SystemSecurity and Communication Networks, 2022
- A pattern-aware self-attention network for distant supervised relation extractionInformation Sciences, 2022
- Price TAG: Towards Semi-Automatically Discovery Tactics, Techniques and Procedures OF E-Commerce Cyber Threat IntelligenceIEEE Transactions on Dependable and Secure Computing, 2021
- Document-level Relation Extraction as Semantic Segmentation2021
- Document-level relation extraction with Entity-Selection AttentionInformation Sciences, 2021
- Design of Anomaly-Based Intrusion Detection System Using Fog Computing for IoT NetworkAutomatic Control and Computer Sciences, 2021
- Information Extraction of Cybersecurity Concepts: An LSTM ApproachApplied Sciences, 2019
- Named Entity Recognition with Bidirectional LSTM-CNNsTransactions of the Association for Computational Linguistics, 2016