UNIVERSAL TRANSFORMER FRAMEWORK FOR TEXT ANALYSIS AND GENERATION
Open Access
- 25 May 2026
- journal article
- Published by Shakarim University in Bulletin of Shakarim University. Technical Sciences
- Vol. 1 (1(21)) , 36-46
Abstract
The article proposes a universal multimodal framework for solving three tasks of natural language processing: sarcasm recognition, sentiment-oriented generation of image descriptions, and contextual neural network machine translation using the reranking mechanism. The architecture includes specialized encoders (BERT, RoBERTa, ViT), cross-modal attention mechanisms, and contrastive learning, which provides adaptation to various types of input data and semantic tasks. The experiments demonstrated improvements in the BLEU, METEOR, F1, and NER metrics compared to the basic models. Special attention is paid to the stability of the model when working with rare words and named entities. The results obtained confirm the effectiveness of the proposed approach in conditions of limited data and multimodal complexity. In the context of the rapid growth of multimedia content and user expression on social networks, multimodal models combining text, visual and stylistic features are becoming a key direction in the development of cognitive AI systems. In particular, transformer architectures open up new horizons in the integration of multi-channel information, allowing us to take into account not only the direct meaning of the text, but also the emotional subtext, visual context and stylistic features of the presentation.Keywords
This publication has 7 references indexed in Scilit:
- Transformer-Based Re-Ranking Model for Enhancing Contextual and Syntactic Translation in Low-Resource Neural Machine TranslationElectronics, 2025
- Optimizing Sentiment Integration in Image Captioning Using Transformer-Based Fusion StrategiesComputers, Materials & Continua, 2025
- Image retrieval from remote sensing big data: A surveyInformation Fusion, 2021
- UNITER: UNiversal Image-TExt Representation Learning2020
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers2019
- Understanding Back-Translation at Scale2018