Exploring Zero-shot Cross-lingual Aspect-based Sentiment Analysis using Pre-trained Multilingual Language Models
Authors:
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Aspect-based sentiment analysis (ABSA) has received much attention in the Natural Language Processing research community. Most of the proposed methods are conducted exclusively in English and high-resources languages. Leveraging resources available from English and transferring to low-resources languages seems to be an immediate solution. In this paper, we investigate the performance of zero-shot cross-lingual transfer learning based on pre-trained multilingual models (mBERT and XLM-R) for two main sub-tasks in the ABSA problem: Aspect Category Detection and Opinion Target Expression. We experiment on the benchmark data sets of six languages as English, Russian, Dutch, Spanish, Turkish, and French. The experimental results demonstrated that using the XLM-R model can yield relatively acceptable results for the zero-shot cross-lingual scenario.Keywords
This publication has 16 references indexed in Scilit:
- Cross-Language Aspect Extraction for Opinion Mining2018
- Deep Contextualized Word Representations2018
- Sentiment Analysis Is a Big SuitcaseIEEE Intelligent Systems, 2017
- Supervised Learning Based Approach to Aspect Based Sentiment Analysis2016
- BUTknot at SemEval-2016 Task 5: Supervised Machine Learning with Term Substitution Approach in Aspect Category Detection2016
- GTI at SemEval-2016 Task 5: SVM and CRF for Aspect Detection and Unsupervised Aspect-Based Sentiment Analysis2016
- SemEval-2016 Task 5: Aspect Based Sentiment Analysis2016
- SemEval-2015 Task 12: Aspect Based Sentiment Analysis2015
- SemEval-2014 Task 4: Aspect Based Sentiment Analysis2014
- Mining and summarizing customer reviews2004