Building and Evaluating an Annotated Corpus for Automated Recognition of Chat-Based Social Engineering Attacks
Open Access
- 17 November 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (22) , 10871
Abstract
Chat-based Social Engineering (CSE) is widely recognized as a key factor to successful cyber-attacks, especially in small and medium-sized enterprise (SME) environments. Despite the interest in preventing CSE attacks, few studies have considered the specific features of the language used by the attackers. This work contributes to the area of early-stage automated CSE attack recognition by proposing an approach for building and annotating a specific-purpose corpus and presenting its application in the CSE domain. The resulting CSE corpus is then evaluated by training a bi-directional long short-term memory (bi-LSTM) neural network for the purpose of named entity recognition (NER). The results of this study emphasize the importance of adding a plethora of metadata to a dataset to provide critical in-context features and produce a corpus that broadens our understanding of the tactics used by social engineers. The outcomes can be applied to dedicated cyber-defence mechanisms utilized to protect SME employees using Electronic Medium Communication (EMC) software.Keywords
This publication has 27 references indexed in Scilit:
- SEADer: A Social Engineering Attack Detection Method Based on Natural Language Processing and Artificial Neural Networks2019
- Social Engineering Attacks: A SurveyFuture Internet, 2019
- Towards an Automated Recognition System for Chat-based Social Engineering Attacks in Enterprise Environments2018
- Rebuilding sample distributions for small dataset learningDecision Support Systems, 2018
- Scamming the Scammers2017
- A Taxonomy of Attacks and a Survey of Defence Mechanisms for Semantic Social Engineering AttacksACM Computing Surveys, 2015
- Transfer learning using computational intelligence: A surveyKnowledge-Based Systems, 2015
- Hierarchical speech-act classification for discourse analysisPattern Recognition Letters, 2013
- Introduction to Linguistic Annotation and Text AnalyticsSynthesis Lectures on Human Language Technologies, 2009
- Generalization of Scott's Index of Intercoder AgreementPublic Opinion Quarterly, 1981