Research on Joint Extraction Model of Financial Product Opinion and Entities Based on RoBERTa
Open Access
- 23 April 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (9) , 1345
Abstract
With the rapid development of the Internet, and its enormous impact on all aspects of life, traditional financial companies increasingly focus on the user’s online reviews, aiming to promote competitiveness and quality of service in the products of this enterprise. Due to the difficulty of extracting comment text compared with structured data itself, coupled with the fact that it is too colloquial, the traditional model insufficiently semantically represents sentences, resulting in unsatisfactory extraction results. Therefore, this paper selects RoBERTa, a pre-trained language model that has exhibited an excellent performance in recent years, and proposes a joint model of financial product opinion and entities extraction based on RoBERTa multi-layer fusion for the two tasks of opinion and entities extraction. The experimental results show that the performance of the proposed joint model on the financial reviews dataset is significantly better than that of the single model.Keywords
Funding Information
- Natural Science Foundation of Zhejiang Province (LY19F020007)
This publication has 20 references indexed in Scilit:
- Pre-Training With Whole Word Masking for Chinese BERTIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
- A hybrid model integrating deep learning with investor sentiment analysis for stock price predictionExpert Systems with Applications, 2021
- S_I_LSTM: stock price prediction based on multiple data sources and sentiment analysisConnection Science, 2021
- Named Entity Recognition Using a Semi-supervised Model Based on BERT and Bootstrapping2021
- Explainable stock prices prediction from financial news articles using sentiment analysisPeerJ Computer Science, 2021
- Financial markets sentiment analysis: developing a specialized LexiconJournal of Intelligent Information Systems, 2020
- RNN based question answer generation and ranking for financial documents using financial NERSādhanā, 2020
- Evaluation of Sentiment Analysis in Finance: From Lexicons to TransformersIEEE Access, 2020
- Deep learning for sentiment analysis: A surveyWIREs Data Mining and Knowledge Discovery, 2018
- Can Twitter Help Predict Firm-Level Earnings and Stock Returns?The Accounting Review, 2017