Collecting Indicators of Compromise from Unstructured Text of Cybersecurity Articles using Neural-Based Sequence Labelling
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
Indicators of Compromise (IOCs) are artifacts observed on a network or in an operating system that can be utilized to indicate a computer intrusion and detect cyber-attacks in an early stage. Thus, they exert an important role in the field of cybersecurity. However, state-of-the-art IOCs detection systems rely heavily on hand-crafted features with expert knowledge of cybersecurity, and require large-scale manually annotated corpora to train an IOC classifier. In this paper, we propose using an end-to-end neural-based sequence labelling model to identify IOCs automatically from cybersecurity articles without expert knowledge of cybersecurity. By using a multi-head self-attention module and contextual features, we find that the proposed model is capable of gathering contextual information from texts of cybersecurity articles and performs better in the task of IOC identification. Experiments show that the proposed model outperforms other sequence labelling models, achieving the average F1-score of 89.0% on English cybersecurity article test set, and approximately the average F1-score of 81.8% on Chinese test set.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Gossip2017
- Semi-supervised sequence tagging with bidirectional language models2017
- Catching Worms, Trojan Horses and PUPs: Unsupervised Detection of Silent Delivery Campaigns2017
- De-identification of patient notes with recurrent neural networksJournal of the American Medical Informatics Association, 2016
- FeatureSmith2016
- Acing the IOC Game2016
- Learning Crosslingual Word Embeddings without Bilingual Corpora2016
- Hierarchical Attention Networks for Document Classification2016
- A lexical approach for classifying malicious URLs2015
- Long Short-Term MemoryNeural Computation, 1997