Training a Quantum Annealing Based Restricted Boltzmann Machine on Cybersecurity Data
- 17 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 6 (3) , 417-428
Abstract
A restricted Boltzmann machine (RBM) is a generative model that could be used in effectively balancing a cybersecurity dataset because the synthetic data a RBM generates follows the probability distribution of the training data. RBM training can be performed using contrastive divergence (CD) and quantum annealing (QA). QA-based RBM training is fundamentally different from CD and requires samples from a quantum computer. We present a real-world application that uses a quantum computer. Specifically, we train a RBM using QA for cybersecurity applications. The D-Wave 2000Q has been used to implement QA. RBMs are trained on the ISCX data, which is a benchmark dataset for cybersecurity. For comparison, RBMs are also trained using CD. CD is a commonly used method for RBM training. Our analysis of the ISCX data shows that the dataset is imbalanced. We present two different schemes to balance the training dataset before feeding it to a classifier. The first scheme is based on the undersampling of benign instances. The imbalanced training dataset is divided into five sub-datasets that are trained separately. A majority voting is then performed to get the result. Our results show the majority vote increases the classification accuracy up from 90.24% to 95.68%, in the case of CD. For the case of QA, the classification accuracy increases from 74.14% to 80.04%. In the second scheme, a RBM is used to generate synthetic data to balance the training dataset. We show that both QA and CD-trained RBM can be used to generate useful synthetic data. Balanced training data is used to evaluate several classifiers. Among the classifiers investigated, K-Nearest Neighbor (KNN) and Neural Network (NN) perform better than other classifiers. They both show an accuracy of 93%. Our results show a proof-of-concept that a QA-based RBM can be trained on a 64-bit binary dataset. The illustrative example suggests the possibility to migrate many practical classification problems to QA-based techniques. Further, we show that synthetic data generated from a RBM can be used to balance the original dataset.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- A Hybrid Malicious Code Detection Method based on Deep LearningInternational Journal of Security and Its Applications, 2015
- Network anomaly detection with the restricted Boltzmann machineNeurocomputing, 2013
- Toward developing a systematic approach to generate benchmark datasets for intrusion detectionComputers & Security, 2012
- Hybrid Intelligent Intrusion Detection Scheme2011
- Simple Proof of Equivalence between Adiabatic Quantum Computation and the Circuit ModelPhysical Review Letters, 2007
- Adiabatic Quantum Computation is Equivalent to Standard Quantum ComputationSIAM Journal on Computing, 2007
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- Data miningACM SIGMOD Record, 2002
- Quantum annealing in the transverse Ising modelPhysical Review E, 1998
- Quantum annealing: A new method for minimizing multidimensional functionsChemical Physics Letters, 1994