Topic Integrated Opinion-Based Drug Recommendation With Transformers
- 14 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 7 (6) , 1676-1686
Abstract
Information from online platforms is vast, with health related data remaining largely unexplored for the purpose of developing a sentiment-based recommendation model. Though state-of-the-art models such as transformers are being researched in this domain, the model configuration has not been diligently investigated, particularly for deriving quality input for sentiment classification by inlaying contextual embeddings and significant sequence segments. A topic modeling and transformer-based model ( topicT-AttNN ) with LSTM and attention mechanism is proposed in this study for classifying sentiments from drug reviews on three aspects and overall opinion. The sentiment score thus obtained is used as a measure for identifying user-advocated drugs for a condition. The proposed model outperforms baselines for all the aspects with higher test accuracy and F1-scores, with the highest F1-score recorded as 0.9585. The results indicate the significance of LSTM and attention layers for identifying words in documents based on the dominance and the competence of the transformer unit in extracting specific context of words in reviews. With this work, we propose that the transformer architecture can be further enhanced with deep learning techniques by contriving potent layers to form the most optimal framework.Keywords
Funding Information
- Australian Research Council (DP220101360)
- National Natural Science Foundation of China (62276196)
- Key Research and Development Project of Hubei Province (2021BAA030)
This publication has 38 references indexed in Scilit:
- How do we talk about doctors and drugs? Sentiment analysis in forums expressing opinions for medical domainArtificial Intelligence in Medicine, 2019
- Sentiment Analysis of Movie Reviews using Machine Learning TechniquesInternational Journal of Computer Applications, 2017
- Exploring convolutional neural networks and topic models for user profiling from drug reviewsMultimedia Tools and Applications, 2017
- Recognition of side effects as implicit-opinion words in drug reviewsOnline Information Review, 2016
- Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum postsJournal of Biomedical Informatics, 2016
- Sentiment analysis and the complex natural languageComplex Adaptive Systems Modeling, 2016
- Sentiment analysis and opinion mining: on optimal parameters and performancesWIREs Data Mining and Knowledge Discovery, 2015
- Sentiment analysis in medical settings: New opportunities and challengesArtificial Intelligence in Medicine, 2015
- New Avenues in Opinion Mining and Sentiment AnalysisIEEE Intelligent Systems, 2013
- Mining FDA drug labels using an unsupervised learning technique - topic modelingBMC Bioinformatics, 2011