A Comparative Study of Deep Learning based Named Entity Recognition Algorithms for Cybersecurity
Authors:
- 10 December 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2596-2604
Abstract
Named Entity Recognition (NER) is important in the cybersecurity domain. It helps researchers extract cyber threat information from unstructured text sources. The extracted cyber-entities or key expressions can be used to model a cyber-attack described in an open-source text. A large number of general-purpose NER algorithms have been published that work well in text analysis. These algorithms do not perform well when applied to the cybersecurity domain. In the field of cybersecurity, the open-source text available varies greatly in complexity and under-lying structure of the sentences. General-purpose NER algorithms can misrepresent domain-specific words, such as "malicious" and "javascript". In this paper, we compare the recent deep learning-based NER algorithms on a cybersecurity dataset. We created a cybersecurity dataset collected from various sources, including "Microsoft Security Bulletin" and "Adobe Security Updates". Some of these approaches proposed in literature were not used for Cybersecurity. Others are innovations proposed by us. This comparative study helps us identify the NER algorithms that are robust and can work well in sentences taken from a large number of cybersecurity sources. We tabulate their performance on the test set and identify the best NER algorithm for a cybersecurity corpus. We also discuss the different embedding strategies that aid in the process of NER for the chosen deep learning algorithms.Keywords
This publication has 14 references indexed in Scilit:
- Named Entity Recognition in Information Security Domain for Russian2019
- RelExt2019
- Named Entity Recognition with Bidirectional LSTM-CNNsTransactions of the Association for Computational Linguistics, 2016
- CyberTwitter: Using Twitter to generate alerts for cybersecurity threats and vulnerabilities2016
- Two-stage approach in Russian named entity recognition2016
- Semi-supervised learning for named entity recognition using weakly labeled training data2015
- A comprehensive study of named entity recognition in Chinese clinical textJournal of the American Medical Informatics Association, 2014
- The Stanford CoreNLP Natural Language Processing Toolkit2014
- Extracting Information about Security Vulnerabilities from Web Text2011
- Unsupervised named-entity extraction from the Web: An experimental studyArtificial Intelligence, 2005