ClickbaitTR: Dataset for clickbait detection from Turkish news sites and social media with a comparative analysis via machine learning algorithms
Authors:
- 12 April 2021
- journal article
- research article
- Published by SAGE Publications in Journal of Information Science
- Vol. 49 (2) , 480-499
Abstract
Clickbait is a strategy that aims to attract people’s attention and direct them to specific content. Clickbait titles, created by the information that is not included in the main content or using intriguing expressions with various text-related features, have become very popular, especially in social media. This study expands the Turkish clickbait dataset that we had constructed for clickbait detection in our proof-of-concept study, written in Turkish. We achieve a 48,060 sample size by adding 8859 tweets and release a publicly available dataset – ClickbaitTR – with its open-source data analysis library. We apply machine learning algorithms such as Artificial Neural Network (ANN), Logistic Regression, Random Forest, Long Short-Term Memory Network (LSTM), Bidirectional Long Short-Term Memory (BiLSTM) and Ensemble Classifier on 48,060 news headlines extracted from Twitter. The results show that the Logistic Regression algorithm has 85% accuracy; the Random Forest algorithm has a performance of 86% accuracy; the LSTM has 93% accuracy; the ANN has 93% accuracy; the Ensemble Classifier has 93% accuracy; and finally, the BiLSTM has 97% accuracy. A thorough discussion is provided for the psychological aspects of clickbait strategy focusing on curiosity and interest arousal. In addition to a successful clickbait detection performance and the detailed analysis of clickbait sentences in terms of language and psychological aspects, this study also contributes to clickbait detection studies with the largest clickbait dataset in Turkish.Keywords
This publication has 13 references indexed in Scilit:
- Using Twitter Data to Monitor Natural Disaster Social Dynamics: A Recurrent Neural Network Approach with Word Embeddings and Kernel Density EstimationSensors, 2019
- Identifying Fake News and Fake Users on TwitterProcedia Computer Science, 2018
- Hybridizing metric learning and case-based reasoning for adaptable clickbait detectionApplied Intelligence, 2017
- Analyzing Refugee Migration Patterns Using Geo-tagged TweetsISPRS International Journal of Geo-Information, 2017
- Dual coordinate descent methods for logistic regression and maximum entropy modelsMachine Learning, 2010
- Random ForestsMachine Learning, 2001
- Bidirectional recurrent neural networksIEEE Transactions on Signal Processing, 1997
- Long Short-Term MemoryNeural Computation, 1997
- The psychology of curiosity: A review and reinterpretation.Psychological Bulletin, 1994
- Conflict, arousal, and curiosity.1960