Meet XLM-RLnews-8: Not Just Another Sentiment Analysis Model
- 20 September 2024
- book chapter
- Published by Springer Nature
- p. 24-35
Abstract
Although automatic sentiment analysis has been widely studied in the past decade, multilingualism remains an issue impairing real-life applications. This paper describes the development and evaluation of XLM-RLnews-8, a model based on XLM-RoBERTa-Large, domain-adapted using a novel dataset of multilingual news articles and fine-tuned for the tripartite sentiment analysis task. In addition, it provides a quantitative analysis of the Unified Multilingual Sentiment Analysis Benchmark, the dataset used for the fine-tuning and the in-domain evaluation. The model is also out-of-domain evaluated, on the IMDb dataset and a new multilingual news headlines silver dataset, and its performance is compared with current State-of-the-Art multilingual models. Models, notebooks and datasets developed for this publication are available at https://github.com/ElisaDiNuovo/XLM-RLnews-8/.Keywords
This publication has 19 references indexed in Scilit:
- Cross-Domain and Cross-Language Irony Detection: The Impact of Bias on Models’ Generalization2023
- A Unified Generative Framework for Aspect-based Sentiment Analysis2021
- Sentiment Analysis2020
- SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets2020
- Improving Sentiment Analysis over non-English Tweets using Multilingual Transformers and Automatic Translation for Data-Augmentation2020
- BERTweet: A pre-trained language model for English Tweets2020
- Unsupervised Cross-lingual Representation Learning at Scale2020
- A Practical Guide to Sentiment Analysis2017
- Shared Task on Sentiment Analysis in Indian Languages (SAIL) Tweets - An Overview2015
- Comparing CorporaCorpus Studies of Language Through Time, 2001