CDTier: A Chinese Dataset of Threat Intelligence Entity Relationships
- 30 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Sustainable Computing
- Vol. 8 (4) , 627-638
Abstract
Cyber Threat Intelligence (CTI), which is knowledge of cyberspace threats gathered from security data, is critical in defending against cyberattacks.However, there is no open-source CTI dataset for security researchers to effectively apply enormous CTI information for security analysis in the field of threat intelligence, particularly in the field of Chinese threat intelligence. As a result, for network security research and development, this paper constructed a Chinese CTI entity relationship dataset–CDTier, which includes: 1) A threat entity extraction dataset composed of 100 CTI reports, 3744 threat sentences and 4259 threat knowledge objects; 2) A dataset for entity relation extraction including 100 CTI reports, 2598 threat sentences and 2562 knowledge object relations. CDTier is, as far as we know, the first CTI dataset. On the CDTier, we trained 4 models for threat entity extraction and relation extraction using well-established and widely used deep learning methods in the NLP. The results showed that the model trained on CDTier extracts knowledge objects and their relationships described in threat intelligence more accurately. This significantly minimizes threat intelligence analysts' work while assessing threat intelligence. The CDTier may be found at https://github.com/MuYu-z/CDTier .Keywords
Funding Information
- National Natural Science Foundation of China (U20B2046)
- National Key Research and Development Program of China (2021YFB2012402)
- Guangdong Province Universities and Colleges Pearl River Schoalar Funded Scheme
- Guangdong Higher Education Innovation Group (2020KCXTD007)
- Guangzhou Higher Education Innovation Group (202032854)
- Guangzhou Basic Research Program (202201020218)
This publication has 27 references indexed in Scilit:
- Information Extraction of Cybersecurity Concepts: An LSTM ApproachApplied Sciences, 2019
- Cyberthreat Detection from Twitter using Deep Neural Networks2019
- Cyber threat intelligence framework using advanced malware forensicsInternational Journal of Information Technology, 2019
- YEDDA: A Lightweight Collaborative Text Span Annotation Tool2018
- TTPDrill2017
- Acing the IOC Game2016
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Chinese Named Entity Recognition with a Sequence Labeling Approach: Based on Characters, or Based on Words?2010
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- Fast Pattern Matching in StringsSIAM Journal on Computing, 1977