On Generating Network Traffic Datasets with Synthetic Attacks for Intrusion Detection
Authors:
Open Access
- 2 January 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Privacy and Security
- Vol. 24 (2) , 1-39
Abstract
Most research in the field of network intrusion detection heavily relies on datasets. Datasets in this field, however, are scarce and difficult to reproduce. To compare, evaluate, and test related work, researchers usually need the same datasets or at least datasets with similar characteristics as the ones used in related work. In this work, we present concepts and the Intrusion Detection Dataset Toolkit (ID2T) to alleviate the problem of reproducing datasets with desired characteristics to enable an accurate replication of scientific results. Intrusion Detection Dataset Toolkit (ID2T) facilitates the creation of labeled datasets by injecting synthetic attacks into background traffic. The injected synthetic attacks created by ID2T blend with the background traffic by mimicking the background traffic’s properties. This article has three core contributions. First, we present a comprehensive survey on intrusion detection datasets. In the survey, we propose a classification to group the negative qualities found in the datasets. Second, the architecture of ID2T is revised, improved, and expanded in comparison to previous work. The architectural changes enable ID2T to inject recent and advanced attacks, such as the EternalBlue exploit or a peer-to-peer botnet. ID2T’s functionality provides a set of tests, known as TIDED, that helps identify potential defects in the background traffic into which attacks are injected. Third, we illustrate how ID2T is used in different use-case scenarios to replicate scientific results with the help of reproducible datasets. ID2T is open source software and is made available to the community to expand its arsenal of attacks and capabilities.Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft (251805230/GRK 2050)
This publication has 25 references indexed in Scilit:
- Taxonomy and Survey of Collaborative Intrusion DetectionACM Computing Surveys, 2015
- An empirical comparison of botnet detection methodsComputers & Security, 2014
- Generation of a new IDS test dataset: Time to retire the KDD collection2013
- Toward developing a systematic approach to generate benchmark datasets for intrusion detectionComputers & Security, 2012
- A Labeled Data Set for Flow-Based Intrusion Detection2009
- The need for simulation in evaluating anomaly detectorsACM SIGCOMM Computer Communication Review, 2008
- Mining anomalies using traffic feature distributionsACM SIGCOMM Computer Communication Review, 2005
- Network traffic anomaly detection based on packet bytes2003
- Testing Intrusion detection systemsACM Transactions on Information and System Security, 2000
- Bro: a system for detecting network intruders in real-timeComputer Networks, 1999