A Hybrid Neural Network Model for Sentiment Analysis of Financial Texts Using Topic Extraction, Pre-Trained Model, and Enhanced Attention Mechanism Methods
Authors:
Open Access
- 16 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 98207-98224
Abstract
In the financial field, texts such as news and commentaries, as carriers of public opinion, have the function of reflecting investor sentiment, influencing investment decisions and market trends, and extracting positive or negative sentiment from them in a timely manner is very important to the investment decisions of fintech companies and investors. However, financial sentiment analysis is challenging due to issues such as unclear sentiment polarity of financial texts, high context-dependency, and highly specialised and specific expressions of the linguistic features of financial texts. In order to overcome these challenges, we design a hybrid topic feature and pre-trained model financial text sentiment analysis model, and we design the method of improved attention mechanism to optimise the model iteratively, the improved attention mechanism reduces the noise caused by the improper allocation of attention to a single word through adaptive attention threshold, attention weight masking mechanism, so as to capture more contextual information and avoid the loss of information, thus improving the stability of the model. This improves the stability of the model. The introduction of thematic features enables the model to capture potential semantic structures and long-distance word associations in the text to enhance the understanding of text context. The experimental results show that the method has an improvement of 2.05%-7.27% in F1 value compared with the baseline method, which is suitable for financial text sentiment analysis.Keywords
This publication has 38 references indexed in Scilit:
- A review on sentiment analysis from social media platformsExpert Systems with Applications, 2023
- Targeted aspect-based emotion analysis to detect opportunities and precaution in financial Twitter messagesExpert Systems with Applications, 2023
- Multilingual Topic Labelling of News Topics Using Ontological Mapping2022
- SEntFiN 1.0: Entity‐aware sentiment analysis for financial newsJournal of the Association for Information Science and Technology, 2022
- A survey on sentiment analysis methods, applications, and challengesArtificial Intelligence Review, 2022
- Sentiment analysis: a review and comparative analysis over social mediaJournal of Ambient Intelligence and Humanized Computing, 2018
- A semi-supervised approach to sentiment analysis using revised sentiment strength based on SentiWordNetKnowledge and Information Systems, 2016
- Automatic Labelling of Topic Models Using Word Vectors and Letter Trigram Vectors2015
- Twitter Sentiment Analysis for Large-Scale Data: An Unsupervised ApproachCognitive Computation, 2014
- Good debt or bad debt: Detecting semantic orientations in economic textsJournal of the Association for Information Science and Technology, 2013