AGF-HAM: Adaptive Gated Fusion Hierarchical Attention Model for Explainable Sentiment Analysis
Open Access
- 5 December 2025
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 13 (24) , 3892
Abstract
The rapid growth of user-generated content in the digital space has increased the necessity of properly and interpretively analyzing sentiment and emotion systems. This research paper presents a new hybrid model, HAM (Hybrid Attention-based Model), a Transformer-based contextual embedding model combined with deep sequential modeling and multi-layer explainability. The suggested framework integrates the BERT/RoBERTa encoders, Bidirectional LSTM, and Graph Attention that can be used to embrace semantic and aspect-level sentiment correlation. Additionally, an enhanced Explainability Module, including Attention Heatmaps, Aspect-Level Interpretations, and SHAP/Integrated Gradients analysis, contributes to the increased model transparency and interpretive reliability. Four benchmark datasets, namely GoEmotions-1, GoEmotions-2, GoEmotions-3, and Amazon Cell Phones and Accessories Reviews, were experimented on in order to have a strong cross-domain assessment. The 28 emotion words of GoEmotions were merged into five sentiment-oriented classes to harmonize the dissimilarity in the emotional granularities to fit the schema of the Amazon dataset. The proposed HAM model had a highest accuracy of 96.4% and F1-score of 94.9%, which was significantly higher than the state-of-the-art baselines like BERT (89.8%), RoBERTa (91.7%), and RoBERTa+BiLSTM (92.5%). These findings support the idea that HAM is a better solution to finer-grained emotional details and is still interpretable as a vital move towards creating open, exposible, and domain-tailored sentiment intelligence systems. Future endeavors will aim at expanding this architecture to multimodal fusion, cross-lingual adaptability, and federated learning systems to increase the scalability, generalization, and ethical application of AI.Keywords
Funding Information
- Princess Nourah Bint Abdulrahman University (PNURSP2025R308)
This publication has 56 references indexed in Scilit:
- Empowering Urdu sentiment analysis: an attention-based stacked CNN-Bi-LSTM DNN with multilingual BERTComplex & Intelligent Systems, 2024
- Generative approach to Aspect Based Sentiment Analysis with GPT Language ModelsProcedia Computer Science, 2023
- Dual-channel and multi-granularity gated graph attention network for aspect-based sentiment analysisApplied Intelligence, 2022
- Multi-class sentiment analysis of urdu text using multilingual BERTScientific Reports, 2022
- A unified position-aware convolutional neural network for aspect based sentiment analysisNeurocomputing, 2021
- Machine learning and deep learningElectronic Markets, 2021
- GPT-3: What’s it good for?Natural Language Engineering, 2020
- Classification of sentiment reviews using n-gram machine learning approachExpert Systems with Applications, 2016
- What is a support vector machine?Nature Biotechnology, 2006
- Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical researchJournal of Pharmaceutical and Biomedical Analysis, 2000