Aspect-level Sentiment Analysis for Social Media Data in the Political Domain using Hierarchical Attention and Position Embeddings
Authors:
- 1 August 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
In this paper we present our work on aspect-level sentiment analysis on social media data, specifically in the political domain. Aside from being linguistically irregular, political tweets are often ambiguous or contain sentiments of opposite polarity. To address this, we use a deep learning architecture with a hierarchical attention and position embeddings to enable a finer-grained analysis of sentiments at different positions in the text. Our dataset consists of3022 tweets on the politics domain in Bahasa Indonesia having 1514 unique aspects. We find that there are two important factors for model performance: first, the use of a gating mechanism of appropriate complexity – in our case, LSTM gives the best performance in terms of accuracy and outperforms GRU and RNN by almost 7% in average recall. Second, the use of a trainable embeddings pre-trained on data in similar domains – a trainable Word2Vec embeddings trained on social media data in Bahasa Indonesia gives more than 4% better accuracy than without trainable embeddings. Our analysis also shows that correctly predicted tweets have more variance in attention weights, in contrast to incorrectly predicted ones to which input tokens are often assigned similar weights. This indicates the usefulness of attention mechanism in an aspect-based sentiment analysis.Keywords
This publication has 5 references indexed in Scilit:
- Hierarchical Attention Based Position-Aware Network for Aspect-Level Sentiment Analysis2018
- Recurrent Attention Network on Memory for Aspect Sentiment Analysis2017
- Neural Machine Translation of Rare Words with Subword Units2016
- Glove: Global Vectors for Word Representation2014
- Long Short-Term MemoryNeural Computation, 1997