Text embedding techniques for efficient clustering of twitter data
- 7 February 2023
- journal article
- research article
- Published by Springer Nature in Evolutionary Intelligence
- Vol. 16 (5) , 1667-1677
Abstract
World wide web is abundant with various types of information such blogs, social media posts, news articles. With this type of magnitude of online content, there is a need to deeply understand the insights of it in order to make use of the information for practical applications such as event detection, polarity, sentiment analysis and so on. Natural Language Processing (NLP) is the study of such information which is used for text classification, sentiment analysis, clustering of similar text. NLP makes use of linguistic knowledge and build machine learning models to analyse textual information. NLP finds its way in various applications like classification of online review into positive and negative without actually reading the reviews and feedback. For text analysis, there should be a way to quantify the text based on its frequency of occurrence, correlation with neighbouring words, contextual similarity of words, etc. One such way is word embedding. This study applies various word embedding techniques on tweets of popular news channels and clusters the resultant vectors using K-means algorithm. From this study, it is found out that Bidirectional Encoder Representations from Transformers (BERT) has achieved highest accuracy rate when used with K-means clustering.Keywords
This publication has 18 references indexed in Scilit:
- Utilizing User Generated Contents to describe Tourism Areas of Interest2019
- Research paper classification systems based on TF-IDF and LDA schemesHuman-centric Computing and Information Sciences, 2019
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks2019
- COSINT: Mining Reasons for Sentiment Variation on Twitter using Cosine Similarity Measurement2018
- PTMIB: Profiling top most influential blogger using content based data mining approach2016
- Similarity in Patient Support Forums Using TF-IDF and Cosine Similarity Metrics2015
- Glove: Global Vectors for Word Representation2014
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987
- A Cluster Separation MeasureIEEE Transactions on Pattern Analysis and Machine Intelligence, 1979
- A cluster separation measure.1979