An Agile Approach to Identify Single and Hybrid Normalization for Enhancing Machine Learning-Based Network Intrusion Detection
Open Access
- 6 October 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 137494-137513
Abstract
Detecting intrusion in network traffic has remained a problematic task for years. Progress in the field of machine learning is paving the way for enhancing intrusion detection systems. Due to this progress intrusion detection has become an integral part of network security. Intrusion detection has achieved high detection accuracy with the help of supervised machine learning methods. A key factor in enhancing the performance of supervised classifiers is how data is augmented for training the classification model. Data in real-world networks or publicly available datasets are not always normally (Gaussian) distributed. Instead, the distributions of variables are more likely to be skewed. To achieve a high detection rate, data normalization or transformation plays an important role for machine learning-based intrusion detection systems. Several methods are available to normalize the attributes of the data before training a classification model. However, opting for the most suitable normalization technique is still a questionable task. In this paper, a statistical method is proposed that can identify the most suitable normalization method for the dataset. The normalization method identified by the proposed approach gives the highest accuracy for an intrusion detection system. To highlight the efficiency of the proposed method, five different datasets were used with two different feature selection methods. The datasets belong to both Internet of things and traditional network environments. The proposed method is also able to identify hybrid normalizations to achieve even improved intrusion detection results.Keywords
Funding Information
- Institute for Information and Communications Technology Planning and Evaluation (IITP-2021-2016-0-00313)
- Ministry of Science and ICT South Korea (NRF-2019R1F1A1062320)
This publication has 25 references indexed in Scilit:
- Mobile Encrypted Traffic Classification Using Deep Learning: Experimental Evaluation, Lessons Learned, and ChallengesIEEE Transactions on Network and Service Management, 2019
- A Deep Learning Approach to Network Intrusion DetectionIEEE Transactions on Emerging Topics in Computational Intelligence, 2018
- Statistical and Geostatistical Applications in Geology2018
- Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection2018
- Toward developing a systematic approach to generate benchmark datasets for intrusion detectionComputers & Security, 2012
- Cohen's kappa coefficient as a performance measure for feature selection2010
- Research on Data Normalization Methods in Multi-Attribute Evaluation2009
- A detailed analysis of the KDD CUP 99 data set2009
- Receiver Operating Characteristic2009
- Attribute Normalization in Network Intrusion Detection2009