A benchmark for Portuguese zero-shot stance detection
Open Access
- 8 March 2024
- journal article
- Published by Sociedade Brasileira de Computação in Journal of the Brazilian Computer Society
- Vol. 30 (1) , 469-479
Abstract
Stance detection is the task of inferring for/against attitudes towards a particular target from text. As targets are in principle unlimited, however, research in the field has moved from so-called in-domain classification (which assume the availability of a sufficient number of stances towards the intended target for training purposes) to more realistic zero-shot scenarios. However, regardless of which - or how much - training data is taken into account, most existing zero-shot approaches are devoted to the English language, in stark opposition to alternatives devoted to Portuguese. As a means to overcome some of these difficulties, this article presents a benchmark (hereby understood as the combination of a dataset, baseline systems and their results) for zero-shot Portuguese stance detection that is, to the best of our knowledge, the first of it kind. More specifically, we adapt a number of existing models available for the English language to Portuguese, and introduce novel approaches to the task based on more recent prompt engineering methods and off-task labelling, achieving SOTA results that are, in some cases, even superior to in-domain classification.Keywords
This publication has 43 references indexed in Scilit:
- Adversarial Network with External Knowledge for Zero-Shot Stance Detection2023
- A systematic review of machine learning techniques for stance detection and its applicationsNeural Computing and Applications, 2023
- Cross-target Stance Classification as Domain Adaptation2022
- Knowledge distillation for BERT unsupervised domain adaptationKnowledge and Information Systems, 2022
- ExaASC: A General Target-Based Stance Detection Corpus in Arabic Language2021
- User profiling and satisfaction inference in public information access servicesJournal of Intelligent Information Systems, 2021
- Stance detection on social media: State of the art and trendsInformation Processing & Management, 2021
- Twitter Moral Stance Classification Using Long Short-Term Memory Networks2020
- Modeling Relational Data with Graph Convolutional Networks2018
- Adversarial Discriminative Domain Adaptation2017