Intelligent text similarity assessment using Roberta with integrated chaotic perturbation optimization techniques
Authors:
Open Access
- 11 July 2025
- journal article
- research article
- Published by Springer Nature in Journal of Big Data
- Vol. 12 (1) , 1-33
Abstract
Precisely evaluating text similarity remains a fundamental challenge in Natural Language Processing (NLP), with widespread applications in plagiarism detection, information retrieval, semantic analysis, and recommendation systems. Traditional approaches often suffer from overfitting, local optima stagnation, and difficulty capturing deep semantic relationships. To address these challenges, this paper introduces an Intelligent Text Similarity Assessment Model that integrates Robustly Optimized Bidirectional Encoder Representations from Transformers (RoBERTa) with Chaotic Sand Cat Swarm Optimization (CHSCSO), a novel swarm intelligence-based optimization method inspired by chaotic dynamics. The model leverages RoBERTa’s robust contextual embeddings to extract deep semantic representations while utilizing CHSCSO’s controlled chaotic perturbations to optimize hyperparameters dynamically. This integration enhances model generalization, mitigates overfitting, and improves the trade-off between exploration and exploitation during training. CHSCSO refines the parameter search space by employing chaotic maps, ensuring a more adaptive and efficient training process. Extensive experiments on multiple benchmark datasets, including Semantic Textual Similarity (STS) and Textual Entailment (TE), demonstrate the model’s superiority over standard RoBERTa fine-tuning and conventional baselines that reach cosine similarity scores that are clustered at 0.996. The optimized model achieves higher accuracy and improved stability and exhibits faster convergence in text similarity tasks.Keywords
Funding Information
- Kafr El Shiekh University
This publication has 44 references indexed in Scilit:
- An optimized ensemble model based on meta-heuristic algorithms for effective detection and classification of breast tumorsNeural Computing and Applications, 2024
- QSFVQA: A Time Efficient, Scalable and Optimized VQA FrameworkArabian Journal for Science and Engineering, 2023
- Sand Cat swarm optimization: a nature-inspired algorithm to solve global optimization problemsEngineering with Computers, 2022
- A novel arithmetic optimization algorithm based on chaotic maps for global optimizationEvolutionary Intelligence, 2022
- The Archerfish Hunting Optimizer: A Novel Metaheuristic Algorithm for Global OptimizationArabian Journal for Science and Engineering, 2021
- A hybrid Harris hawks-moth-flame optimization algorithm including fractional-order chaos maps and evolutionary population dynamicsAdvances in Engineering Software, 2021
- Cross-projects software defect prediction using spotted hyena optimizer algorithmSN Applied Sciences, 2020
- I-GWO and Ex-GWO: improved algorithms of the Grey Wolf Optimizer to solve global optimization problemsEngineering with Computers, 2019
- Biogeography-based optimisation with chaosNeural Computing and Applications, 2014
- Grey Wolf OptimizerAdvances in Engineering Software, 2014