Generative Artificial Intelligence and Machine Translators in Spanish Translation of Early Vulnerability Cybersecurity Alerts
Open Access
- 8 April 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (8) , 4090
Abstract
The increasing reliance on artificial intelligence in cybersecurity has broadened the role of generative artificial intelligence in tasks such as text generation and translation. This study assesses the effectiveness of generative artificial intelligence and conventional translation tools in translating early vulnerability alerts from English to Spanish—a critical process for ensuring the timely dissemination of cybersecurity information. Utilizing a dataset provided by the Spanish National Cybersecurity Institute, translations were generated using various systems and evaluated through linguistic assessment metrics, including methods measuring lexical similarity and others capturing semantic meaning beyond direct word matching. Additionally, word embeddings were employed to enhance the accuracy of semantic similarity analysis. The results indicate that conventional translation tools generally exhibit greater accuracy and structural fidelity, whereas generative artificial intelligence produces more natural-sounding translations. However, this flexibility results in greater variability in translation quality. The findings suggest that while generative artificial intelligence may serve as a valuable complement to traditional tools, its inconsistencies may limit its suitability for highly technical content that demands precision. This study underscores the importance of integrating both approaches to improve the accuracy and accessibility of cybersecurity alerts across different languages.Keywords
Funding Information
- Strategic Project Data Science for an Artificial Intelligence Model in Cybersecurity (C073/23)
- European Union (C073/23)
This publication has 16 references indexed in Scilit:
- A comparative analysis of generative artificial intelligence responses from leading chatbots to questions about endometriosisAJOG Global Reports, 2024
- What are the differences? A comparative study of generative artificial intelligence translation and human translation of scientific textsHumanities and Social Sciences Communications, 2024
- Generative artificial intelligence: a systematic review and applicationsMultimedia Tools and Applications, 2024
- Artificial intelligence and posthumanist translation: ChatGPT versus the translatorApplied Linguistics Review, 2023
- COMET: A Neural Framework for MT Evaluation2020
- YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available Resources2019
- Unsupervised Quality Estimation Without Reference Corpus for Subtitle Machine Translation Using Word Embeddings2019
- Enriching Word Vectors with Subword InformationTransactions of the Association for Computational Linguistics, 2017
- BLEU2001
- A Generalized Solution of the Orthogonal Procrustes ProblemPsychometrika, 1966