A Mixed Malay–English Language COVID-19 Twitter Dataset: A Sentiment Analysis
Open Access
- 27 March 2023
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 7 (2) , 61
Abstract
Social media has evolved into a platform for the dissemination of information, including fake news. There is a lot of false information about the current situation of the Coronavirus Disease 2019 (COVID-19) pandemic, such as false information regarding vaccination. In this paper, we focus on sentiment analysis for Malaysian COVID-19-related news on social media such as Twitter. Tweets in Malaysia are often a combination of Malay, English, and Chinese with plenty of short forms, symbols, emojis, and emoticons within the maximum length of a tweet. The contributions of this paper are twofold. Firstly, we built a multilingual COVID-19 Twitter dataset, comprising tweets written from 1 September 2021 to 12 December 2021. In particular, we collected 108,246 tweets, with over in Malay language, in English, in Chinese, and in other languages. We then manually annotated and assigned the sentiment of 11,568 tweets into three-class sentiments (positive, negative, and neutral) to develop a Malay-language sentiment analysis tool. For this purpose, we applied a data compression method using Byte-Pair Encoding (BPE) on the texts and used two deep learning approaches, i.e., the Multilingual Bidirectional Encoder Representation for Transformer (M-BERT) and convolutional neural network (CNN). BPE tokenization is used to encode rare and unknown words into smaller meaningful subwords. With the CNN, we converted the labeled tweets into image files. Our experiments explored different BPE vocabulary sizes with our BPE-Text-to-Image-CNN and BPE-M-BERT models. The results show that the optimal vocabulary size for BPE is 12,000; any values beyond that would not contribute much to the F1-score. Overall, our results show that BPE-M-BERT slightly outperforms the CNN model, thereby showing that the pre-trained M-BERT network has the advantage for our multilingual dataset.
Keywords
Funding Information
- Ministry of Higher Education, Malaysia (FRGS/1/2020/ICT06/CURTIN/02/1, NKB-1409/UN2.RST/HKP.05.00/2020)
- Universitas Indonesia (FRGS/1/2020/ICT06/CURTIN/02/1, NKB-1409/UN2.RST/HKP.05.00/2020)
This publication has 38 references indexed in Scilit:
- Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral informationCognitive Systems Research, 2019
- Sentiment Analysis of Twitter DataInternational Journal of Healthcare Information Systems and Informatics, 2019
- Developing Cross-lingual Sentiment Analysis of Malay Twitter Data Using Lexicon-based ApproachInternational Journal of Advanced Computer Science and Applications, 2019
- Global news-making practices on Twitter: Exploring English-Chinese language boundary spanningJournal of International and Intercultural Communication, 2019
- Malay sentiment analysis based on combined classification approaches and Senti-lexicon algorithmPLOS ONE, 2018
- Machine Learning-Based Sentiment Analysis for Twitter AccountsMathematical and Computational Applications, 2018
- Bias aware lexicon-based Sentiment Analysis of Malay dialect on social media data: A study on the Sabah Language2017
- A Practical Guide to Sentiment Annotation: Challenges and Solutions2016
- Hybrid approach for aligning parallel sentences for languages without a written form using standard Malay and Malay dialects2014
- Development of Sarawak Malay Local Dialect Online Translation Tool2009