Federated Learning for Sarcasm Detection: A Study of Attention-Enhanced BILSTM, GRU, and LSTM Architectures
Open Access
- 20 December 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 196786-196802
Abstract
The previous centralized machine learning methods required combining large amounts of personal data on central servers, raising privacy concerns. Federated Learning (FL) presents a solution by training the models directly on users’ devices, thus preserving data privacy. This paper proposes the use of FL in sarcasm detection and applying neural network architectures such as Bidirectional Long Short-Term Memory (BILSTM), Gated Recurrent Unit (GRU), and Long Short-Term Memory (LSTM). The experiments have been performed on multiple clients. The results have shown that BILSTM outperforms GRU and LSTM in terms of accuracy, precision, recall, and F1 score. This makes it the most effective model for sarcasm detection in a FL. Apart from evaluating these models, this study also examined how their functionality may be further improved by integrating them with attention processes. The current study results show that attention-based models can significantly improve performance by focusing on the input parts that are more contextually relevant. Based on this work, future research could focus on improving the performance of these models and exploring hybrid approaches that combine the benefits of LSTM, GRU, and BILSTM.Keywords
Funding Information
- Emerging Intelligent Autonomous Systems (EIAS) Data Science Laboratory, Prince Sultan University, Saudi Arabia
- Prince Sultan University for the Article Processing Charges
This publication has 53 references indexed in Scilit:
- Optimizing energy efficiency and comfort in smart homes through predictive optimization: A case study with indoor environmental parameter considerationEnergy Reports, 2024
- Multi-modal fusion approaches for tourism: A comprehensive survey of data-sets, fusion techniques, recent architectures, and future directionsComputers and Electrical Engineering, 2024
- Comparative Analysis of Wind Power Forecasting Using LSTM, BiLSTM, and GRU2023
- Sarcasm detection using news headlines datasetAI Open, 2023
- A Proposed Federated Learning Model for Vaccination Tweets2022
- Attention mechanism in neural networks: where it comes and where it goesNeural Computing and Applications, 2022
- Sarcasm detection using deep learning and ensemble learningMultimedia Tools and Applications, 2022
- An intelligent machine learning-based sarcasm detection and classification model on social networksThe Journal of Supercomputing, 2022
- A transformer-based approach to irony and sarcasm detectionNeural Computing and Applications, 2020
- Sarcasm identification in textual data: systematic review, research challenges and open directionsArtificial Intelligence Review, 2019