DarkVec
Authors:
Open Access
- 2 December 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 76-89
Abstract
Darknets are passive probes listening to traffic reaching IP addresses that host no services. Traffic reaching them is unsolicited by nature and often induced by scanners, malicious senders and misconfigured hosts. Its peculiar nature makes it a valuable source of information to learn about malicious activities. However, the massive amount of packets and sources that reach darknets makes it hard to extract meaningful insights. In particular, multiple senders contact the darknet while performing similar and coordinated tasks, which are often commanded by common controllers (botnets, crawlers, etc.). How to automatically identify and group those senders that share similar behaviors remains an open problem. We here introduce DarkVec, a methodology to identify clusters of senders (i.e., IP addresses) engaged in similar activities on darknets. DarkVec leverages word embedding techniques (e.g., Word2Vec) to capture the co-occurrence patterns of sources hitting the darknets. We extensively test DarkVec and explore its design space in a case study using one month of darknet data. We show that with a proper definition of service, the generated embeddings can be easily used to (i) associate unknown senders' IP addresses to the correct known labels (more than 96% accuracy), and (ii) identify new attack and scan groups of previously unknown senders. We contribute DarkVec source code and datasets to the community also to stimulate the use of word embeddings to automatically learn patterns on generic traffic traces.Keywords
Funding Information
- Huawei R&D Center (France)
- SmartData@PoliTO center for Big Data technologies
This publication has 13 references indexed in Scilit:
- Improving IoT Botnet Investigation Using an Adaptive Network LayerSensors, 2019
- IP2Vec: Learning Similarities Between IP Addresses2017
- DBSCAN Revisited, RevisitedACM Transactions on Database Systems, 2017
- Knowledge discovery of port scans from darknet2017
- Darknet as a Source of Cyber Intelligence: Survey, Taxonomy, and CharacterizationIEEE Communications Surveys & Tutorials, 2015
- Inferring distributed reflection denial of service attacks from darknetComputer Communications, 2015
- Analysis of a “/0” Stealth Scan From a BotnetIEEE/ACM Transactions on Networking, 2014
- Community detection in Social MediaData Mining and Knowledge Discovery, 2011
- Fast unfolding of communities in large networksJournal of Statistical Mechanics: Theory and Experiment, 2008
- Inferring Internet denial-of-service activityACM Transactions on Computer Systems, 2006