Sentiment Analysis Using XLM-R Transformer and Zero-shot Transfer Learning on Resource-poor Indian Language
Authors:
Open Access
- 30 June 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 20 (5) , 1-13
Abstract
Sentiment analysis on social media relies on comprehending the natural language and using a robust machine learning technique that learns multiple layers of representations or features of the data and produces state-of-the-art prediction results. The cultural miscellanies, geographically limited trending topic hash-tags, access to aboriginal language keyboards, and conversational comfort in native language compound the linguistic challenges of sentiment analysis. This research evaluates the performance of cross-lingual contextual word embeddings and zero-shot transfer learning in projecting predictions from resource-rich English to resource-poor Hindi language. The cross-lingual XLM-RoBERTa classification model is trained and fine-tuned using the English language Benchmark SemEval 2017 dataset Task 4 A and subsequently zero-shot transfer learning is used to evaluate the classification model on two Hindi sentence-level sentiment analysis datasets, namely, IITP-Movie and IITP-Product review datasets. The proposed model compares favorably to state-of-the-art approaches and gives an effective solution to sentence-level (tweet-level) analysis of sentiments in a resource-poor scenario. The proposed model compares favorably to state-of-the-art approaches and achieves an average performance accuracy of 60.93 on both the Hindi datasets.Keywords
This publication has 30 references indexed in Scilit:
- Zero-Shot Multilingual Sentiment Analysis using Hierarchical Attentive Network and BERT2019
- A comprehensive survey of arabic sentiment analysisInformation Processing & Management, 2019
- Systematic literature review on context-based sentiment analysis in social multimediaMultimedia Tools and Applications, 2019
- Solving Data Sparsity for Aspect Based Sentiment Analysis Using Cross-Linguality and Multi-Linguality2018
- BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs2017
- IIT-TUDA: System for Sentiment Analysis in Indian Languages Using Lexical Acquisition2015
- Shared Task on Sentiment Analysis in Indian Languages (SAIL) Tweets - An Overview2015
- AMRITA-CEN@SAIL2015: Sentiment Analysis in Indian Languages2015
- Sentiment Analysis and Opinion MiningSynthesis Lectures on Human Language Technologies, 2012
- Using sentiment orientation features for mood classification in blogs2009