An Attention-Based Neural Network Using Human Semantic Knowledge and Its Application to Clickbait Detection
Authors:
Open Access
- 12 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of the Computer Society
- Vol. 3, 217-232
Abstract
Clickbait is a commonly used social engineering technique to carry out phishing attacks, illegitimate marketing, and dissemination of disinformation. As a result, clickbait detection has become a popular research topic in recent years due to the prevalence of clickbait on the web and social media. In this article, we propose a novel attention-based neural network for the task of clickbait detection. To the best of our knowledge, our work is the first that incorporates human semantic knowledge into an artificial neural network, and uses linguistic knowledge graphs to guide attention mechanisms for the clickbait detection task. Extensive experimental results show that the proposed model outperforms existing state-of-the-art clickbait classifiers, even when training data is limited. The proposed model also performs better or comparably to powerful pre-trained models, namely, BERT, RoBERTa, and XLNet, while being much more lightweight. Furthermore, we conducted experiments to demonstrate that the use of human semantic knowledge can significantly enhance the performance of pre-trained models in the semi-supervised domain such as BERT, RoBERTa, and XLNet.Keywords
Funding Information
- Discovery Grant
- Natural Sciences and Engineering Research Council of Canada
This publication has 49 references indexed in Scilit:
- The Stanford CoreNLP Natural Language Processing Toolkit2014
- Glove: Global Vectors for Word Representation2014
- The persistent effects of a false news shockJournal of Empirical Finance, 2011
- Long Short-Term MemoryNeural Computation, 1997
- WordNetCommunications of the ACM, 1995
- Approximation capabilities of multilayer feedforward networksNeural Networks, 1991
- Learning representations by back-propagating errorsNature, 1986
- A computer readability formula designed for machine scoring.Journal of Applied Psychology, 1975
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958
- A logical calculus of the ideas immanent in nervous activityBulletin of Mathematical Biology, 1943