Individual vs. Group Violent Threats Classification in Online Discussions
Authors:
Open Access
- 20 April 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 629-633
Abstract
Violent threat is a serious crime affecting the targeted individuals or groups. It is essential for media providers to block the users that post such threats. In this paper, we focused on detection of violent threat language in YouTube comments. We categorized the threatening comments into those targeting an individual or a group. We started from an existing dataset with violent threat language identified, but without any categorization into comments targeting individuals or groups. We adopted a binary classification approach for the prediction of individual- vs. group-targeting threats. We compared two text representations: bag of words (BOW) and pre-trained word embedding such as GloVe and fastText. We used deep-learning classifiers such as 1D-CNN, LSTM, and bidirectional LSTM (BiLSTM). GloVe embedding showed the worst results, fastText performed much better, and BiLSTM on BOW with term frequency-inverse document frequency (TF-IDF) weighting scheme gave the best results, achieving 0.94% ROC-AUC and Macro-F1 score of 0.85%.Keywords
This publication has 13 references indexed in Scilit:
- Application of Long Short-Term Memory (LSTM) Neural Network for Flood ForecastingWater, 2019
- Human aggressiveness and reactions towards uncertain decisionsInternational Journal of ADVANCED AND APPLIED SCIENCES, 2019
- Finding Good Conversations Online: The Yahoo News Annotated Comments Corpus2017
- Constructive Language in News Comments2017
- Using KNN and SVM Based One-Class Classifier for Detecting Online Radicalization on Twitter2015
- Convolutional Neural Networks for Sentence Classification2014
- N-Gram-Based Recognition of Threatening Tweets2013
- The United Nations International Covenant on Civil and Political Rights: Does It Make a Difference in Human Rights Behavior?Journal of Peace Research, 1999
- The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem SolutionsInternational Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 1998
- Long Short-Term MemoryNeural Computation, 1997