Machine-Learning Approach to Optimize SMOTE Ratio in Class Imbalance Dataset for Intrusion Detection
Open Access
- 1 November 2018
- journal article
- research article
- Published by Wiley in Computational Intelligence and Neuroscience
- Vol. 2018, 1-11
Abstract
The KDD CUP 1999 intrusion detection dataset was introduced at the third international knowledge discovery and data mining tools competition, and it has been widely used for many studies. The attack types of KDD CUP 1999 dataset are divided into four categories: user to root (U2R), remote to local (R2L), denial of service (DoS), and Probe. We use five classes by adding the normal class. We define the U2R, R2L, and Probe classes, which are each less than 1% of the total dataset, as rare classes. In this study, we attempt to mitigate the class imbalance of the dataset. Using the synthetic minority oversampling technique (SMOTE), we attempted to optimize the SMOTE ratios for the rare classes (U2R, R2L, and Probe). After randomly generating a number of tuples of SMOTE ratios, these tuples were used to create a numerical model for optimizing the SMOTE ratios of the rare classes. The support vector regression was used to create the model. We assigned each instance in the test dataset to the model and chose the best SMOTE ratios. The experiments using machine-learning techniques were conducted using the best ratios. The results using the proposed method were significantly better than those of previous approach and other related work.Keywords
Funding Information
- Wonkwang University
This publication has 15 references indexed in Scilit:
- A Study on the Performance Evaluation of Unbalanced Intrusion Detection Dataset Classification based on Machine LearningJournal of Korean Institute of Intelligent Systems, 2017
- Applying long short-term memory recurrent neural networks to intrusion detectionSouth African Computer Journal, 2015
- Data preprocessing for anomaly based network intrusion detection: A reviewComputers & Security, 2011
- RUSBoost: A Hybrid Approach to Alleviating Class ImbalanceIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2009
- Handling class imbalance in customer churn predictionExpert Systems with Applications, 2009
- Training cost-sensitive neural networks with methods addressing the class imbalance problemIEEE Transactions on Knowledge and Data Engineering, 2005
- A tutorial on support vector regressionStatistics and Computing, 2004
- The class imbalance problem: A systematic study1Intelligent Data Analysis: An International Journal, 2002
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002
- Support vector machinesIEEE Intelligent Systems and their Applications, 1998