Towards NLP-based Processing of Honeypot Logs
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 314-321
Abstract
Honeypots are active sensors deployed to obtain information about attacks. In their search for vulnerabilities, attackers generate large volumes of logs, whose analysis is time consuming and cumbersome. We here evaluate whether Natural Language Processing (NLP) approaches can provide meaningful representations to find common traits in attackers' activity. We consider a widely used SSH/Telnet honeypot to record more than 200000 sessions, including 61000 unique shell scripts, some containing sequences of more than 100 Bash commands. We first parse the sessions to separate Bash commands, options and parameters. Next, we project each session in a metric space opposing two common tools used in NLP: Bag of Words and Word2Vec. Last, we leverage a clustering algorithm to aggregate the sessions while offering an instrumental representation of the clustering process. In the end, we obtain few tens of clusters that we analyze to explain the attackers' goals, i.e., obtain system information, inject malicious accounts, download and run executables, etc. Our work is a first step towards automatically identifying attack patterns on honeypots, thus effectively supporting security activities.Keywords
This publication has 8 references indexed in Scilit:
- DarkVec2021
- Explainable Natural Language to Bash Translation using Abstract Syntax Tree2021
- Honeypot Cowrie Implementation to Protect SSH Protocol in Ubuntu Server with Visualisation Using Kippo-GraphInternational Journal of Advanced Trends in Computer Science and Engineering, 2019
- Improving Performances of Log Mining for Anomaly Prediction Through NLP-Based Log Parsing2018
- DeepLog2017
- Neural Network Methods for Natural Language ProcessingSynthesis Lectures on Human Language Technologies, 2017
- Before we knew it2012
- A data clustering algorithm for mining patterns from event logs2004