Real-Time Detection of Dictionary DGA Network Traffic Using Deep Learning
Open Access
- 22 February 2021
- journal article
- research article
- Published by Springer Nature in SN Computer Science
- Vol. 2 (2) , 1-17
Abstract
Botnets and malware continue to avoid detection by static rule engines when using domain generation algorithms (DGAs) for callouts to unique, dynamically generated web addresses. Common DGA detection techniques fail to reliably detect DGA variants that combine random dictionary words to create domain names that closely mirror legitimate domains. To combat this, we created a novel hybrid neural network, Bilbo the “bagging” model, that analyses domains and scores the likelihood they are generated by such algorithms and therefore are potentially malicious. Bilbo is the first parallel usage of a convolutional neural network (CNN) and a long short-term memory (LSTM) network for DGA detection. Our unique architecture is found to be the most consistent in performance in terms of AUC, $$F_1$$ score, and accuracy when generalising across different dictionary DGA classification tasks compared to current state-of-the-art deep learning architectures. We validate using reverse-engineered dictionary DGA domains and detail our real-time implementation strategy for scoring real-world network logs within a large enterprise. In 4 h of actual network traffic, the model discovered at least five potential command-and-control networks that commercial vendor tools did not flag.
Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- DeepDGA2016
- Domain-Z: 28 Registrations Later Measuring the Exploitation of Residual Trust in Domains2016
- Tweet2Vec2016
- Detection of Early-Stage Enterprise Infection by Mining Large-Scale Log Data2015
- On the Character of Phishing URLs2015
- Effective Use of Word Order for Text Categorization with Convolutional Neural Networks2015
- Unsupervised, low latency anomaly detection of algorithmically generated domain names by generative probabilistic modelingJournal of Advanced Research, 2014
- Convolutional Neural Networks for Sentence Classification2014
- Phoenix: DGA-Based Botnet Tracking and Intelligence2014
- Inside risksReflections on ConfickerCommunications of the ACM, 2009