Towards Supercomputing Categorizing the Maliciousness upon Cybersecurity Blacklists with Concept Drift
Open Access
- 20 May 2023
- journal article
- research article
- Published by Wiley in Computational and Mathematical Methods
- Vol. 2023, 1-8
Abstract
In this article, we have carried out a case study to optimize the classification of the maliciousness of cybersecurity events by IP addresses using machine learning techniques. The optimization is studied focusing on time complexity. Firstly, we have used the extreme gradient boosting model, and secondly, we have parallelized the machine learning algorithm to study the effect of using a different number of cores for the problem. We have classified the cybersecurity events’ maliciousness in a biclass and a multiclass scenario. All the experiments have been carried out with a well-known optimal set of features: the geolocation information of the IP address. However, the geolocation features of an IP address can change over time. Also, the relation between the IP address and its label of maliciousness can be modified if we test the address several times. Then, the models’ performance could degrade because the information acquired from training on past samples may not generalize well to new samples. This situation is known as concept drift. For this reason, it is necessary to study if the optimization proposed works in a concept drift scenario. The results show that the concept drift does not degrade the models. Also, boosting algorithms achieving competitive or better performance compared to similar research works for the biclass scenario and an effective categorization for the multiclass case. The best efficient setting is reached using five nodes regarding high-performance computation resources.Keywords
Funding Information
- Spanish National Cybersecurity Institute (83, 203 key: X54)
This publication has 15 references indexed in Scilit:
- Machine learning for automatic assignment of the severity of cybersecurity eventsComputational and Mathematical Methods, 2019
- Analyzing concept drift and shift from sample dataData Mining and Knowledge Discovery, 2018
- Learning under Concept Drift: A ReviewIEEE Transactions on Knowledge and Data Engineering, 2018
- (Un)wisdom of Crowds: Accurately Spotting Malicious IP Clusters Using Not-So-Accurate IP BlacklistsIEEE Transactions on Information Forensics and Security, 2017
- XGBoost2016
- Characterizing concept driftData Mining and Knowledge Discovery, 2016
- Predicting Cyber Security Incidents Using Feature-Based Characterization of Network-Level Malicious Activities2015
- A survey on concept drift adaptationACM Computing Surveys, 2014
- What computational scientists and engineers should know about parallelism and performanceComputer Applications in Engineering Education, 1996
- Comparison of the predicted and observed secondary structure of T4 phage lysozymeBiochimica et Biophysica Acta (BBA) - Protein Structure, 1975