Mitigating out-of-vocabulary challenges in embedded devices vulnerability classification: An ensemble embedding approach with bidirectional context modeling
Open Access
- 1 January 2026
- journal article
- Published by National Library of Serbia in Computer Science and Information Systems
- Vol. 23 (1) , 397-417
Abstract
Critical infrastructure is increasingly reliant on embedded systems, which are particularly vulnerable to cyberattacks due to their inherent complexity and interconnectivity. Accurate classification of vulnerabilities in these systems is essential for targeted analysis and mitigation strategies. While pre-trained word embeddings such as Word2Vec, GloVe, and FastText are commonly used for this purpose, their effectiveness is limited by reliance on training corpora that lack domainspecific terminology, leading to challenges with Out-of-Vocabulary words and reduced classification performance. To address this limitation, we propose a novel ensemble embedding technique that combines multiple pre-trained embeddings to improve vulnerability classification in embedded systems. Evaluated on benchmark datasets, including the National Vulnerability Database and the China National Vulnerability Database, our method achieves a 91.50% F1-score on unseen data, outperforming traditional single-embedding approaches. This advancement demonstrates significant potential for enhancing cybersecurity in critical infrastructure applications.Keywords
This publication has 14 references indexed in Scilit:
- An automatic classification algorithm for software vulnerability based on weighted word vector and fusion neural networkComputers & Security, 2022
- A Deep Learning Approach for Classifying Vulnerability Descriptions Using Self Attention Based Neural NetworkJournal of Network and Systems Management, 2021
- An automatic software vulnerability classification framework using term frequency-inverse gravity moment and feature selectionJournal of Systems and Software, 2020
- Software vulnerability prioritization using vulnerability descriptionInternational Journal of System Assurance Engineering and Management, 2020
- Automatic Classification Method for Software Vulnerability Based on Deep Neural NetworkIEEE Access, 2019
- A multi-target approach to estimate software vulnerability characteristics and severity scoresJournal of Systems and Software, 2018
- Learning to Predict Severity of Software Vulnerability Using Only Vulnerability Description2017
- A Study on the Classification of Common Vulnerabilities and Exposures using Naïve Bayes2016
- Embedded systems security: Threats, vulnerabilities, and attack taxonomy2015
- Vulnerability categorization using Bayesian networks2010