DualKanbaFormer: An Efficient Selective Sparse Framework for Multimodal Aspect-Based Sentiment Analysis
- 1 August 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 10 (4) , 2843-2855
Abstract
Multimodal Aspect-Based Sentiment Analysis (MABSA) enhances sentiment detection by integrating text with complementary modalities, such as images, for a more comprehensive understanding of aspect-level sentiment. Despite notable progress, existing MABSA methods still lack strong aspect awareness, particularly in sentences with multiple aspects and conflicting sentiments or when visual cues are misaligned with the text. Together, these issues hinder accurate modeling of aspect-focused and cross-modal dependencies, limiting the effectiveness of MABSA. To address these challenges, we propose DualKanbaFormer, a novel framework with parallel Textual and Visual KanbaFormer modules tailored for MABSA. At its core, the model introduces Aspect-Driven Sparse Attention (ADSA) with an aspect-aware attention gating mechanism, which dynamically regulates the contributions of Scope, Focus, and Proximity attention branches conditioned on the target aspect. This ensures precise alignment between aspects and opinion signals. In addition, the selective state space model Mamba strengthens aspect–opinion alignment by modeling long-range dependencies across modalities. To enhance representational expressiveness and training stability, Kolmogorov–Arnold Networks (KANs) and Dynamic Tanh (DyT) replace conventional feed-forward and normalization layers. Finally, a CNN-based multimodal gated fusion module adaptively regulates cross-modal interactions, ensuring robust alignment between textual and visual features. Experiments on two benchmark datasets demonstrate that DualKanbaFormer outperforms several state-of-the-art models.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62577006)
This publication has 27 references indexed in Scilit:
- Dual-stream multi-level interaction network for aspect-based multimodal sentiment analysisSignal, Image and Video Processing, 2025
- Transformers without Normalization2025
- Prompt Fusion and Aspect-Oriented Filtration for Aspect-Based Multimodal Sentiment Analysis2025
- Multilayer interactive attention bottleneck transformer for aspect-based multimodal sentiment analysisMultimedia Systems, 2024
- Relevance-aware visual entity filter network for multimodal aspect-based sentiment analysisInternational Journal of Machine Learning and Cybernetics, 2024
- Multi-grained fusion network with self-distillation for aspect-based multimodal sentiment analysisKnowledge-Based Systems, 2024
- Multi-level textual-visual alignment and fusion network for multimodal aspect-based sentiment analysisArtificial Intelligence Review, 2024
- Aspect-level multimodal sentiment analysis based on co-attention fusionInternational Journal of Data Science and Analytics, 2024
- AMIFN: Aspect-guided multi-view interactions and fusion network for multimodal aspect-based sentiment analysisNeurocomputing, 2024
- Deep Residual Learning for Image Recognition2016