Encoding Syntactic Information into Transformers for Aspect-Based Sentiment Triplet Extraction
Open Access
- 7 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (2) , 722-735
Abstract
Aspect-based sentiment triplet extraction (ASTE) aims to extract triplets consisting of aspect terms and their associated opinion terms and sentiment polarities from sentences, a relatively new and challenging subtask of aspect-based sentiment analysis (ABSA). Previous studies have used either pipeline models or unified tagging schema models. These models ignore the syntactic relationships between the aspect and its corresponding opinion words, which leads them to mistakenly focus on syntactically unrelated words. One feasible option is to use a graph convolution network (GCN) to exploit syntactic information by propagating the representation from the opinion words to the aspect. However, such a method considers all syntactic dependencies to be of the same type and thus may still incorrectly associate unrelated words to the target aspect through the iterations of graph convolutional propagation. Herein, a syntax-aware transformer (SA-Transformer) is proposed to extend the GCN strategy by fully exploiting the dependency types of edges to block inappropriate propagation. The proposed approach can obtain different representations and weights even for edges with the same dependency type according to their adjacent dependency type of edges. Instead of using a GCN layer, we used an L -layer SA transformer to encode syntactic information in the word-pair representation to improve performance. Experimental results on four benchmark datasets show that the proposed model outperforms various previous models for ASTE.Keywords
Funding Information
- National Natural Science Foundation of China (61966038)
- Ministry of Science and Technology, Taiwan (MOST111-2628-E-155-001-MY2)
This publication has 51 references indexed in Scilit:
- Multi-task Alignment Scheme for Span-level Aspect Sentiment Triplet Extraction2022
- Double embedding and bidirectional sentiment dependence detector for aspect sentiment triplet extractionKnowledge-Based Systems, 2022
- Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networksKnowledge-Based Systems, 2022
- Aspect term extraction for opinion mining using a Hierarchical Self-Attention NetworkNeurocomputing, 2021
- Syntactic Edge-Enhanced Graph Convolutional Networks for Aspect-Level Sentiment Classification With Interactive AttentionIEEE Access, 2020
- Improving aspect-level sentiment analysis with aspect extractionNeural Computing and Applications, 2020
- Distinguishing between facts and opinions for sentiment analysis: Survey and challengesInformation Fusion, 2018
- Natural language based financial forecasting: a surveyArtificial Intelligence Review, 2017
- A survey of multimodal sentiment analysisImage and Vision Computing, 2017
- Understanding bag-of-words model: a statistical frameworkInternational Journal of Machine Learning and Cybernetics, 2010