PLLM-CS: Pre-trained Large Language Model (LLM) for Cyber Threat Detection in Satellite Networks
Authors:
Preprint
Abstract
Satellite networks are vital in facilitating communication services for various critical infrastructures. These networks can seamlessly integrate with a diverse array of systems. However, some of these systems are vulnerable due to the absence of effective intrusion detection systems, which can be attributed to limited research and the high costs associated with deploying, fine-tuning, monitoring, and responding to security breaches. To address these challenges, we propose a pretrained Large Language Model for Cyber Security , for short PLLM-CS, which is a variant of pre-trained Transformers [1], which includes a specialized module for transforming network data into contextually suitable inputs. This transformation enables the proposed LLM to encode contextual information within the cyber data. To validate the efficacy of the proposed method, we conducted empirical experiments using two publicly available network datasets, UNSW_NB 15 and TON_IoT, both providing Internet of Things (IoT)-based traffic data. Our experiments demonstrate that proposed LLM method outperforms state-of-the-art techniques such as BiLSTM, GRU, and CNN. Notably, the PLLM-CS method achieves an outstanding accuracy level of 100% on the UNSW_NB 15 dataset, setting a new standard for benchmark performance in this domain.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Crossformer3D: cross spatio-temporal transformer for 3D human pose estimationSignal, Image and Video Processing, 2025
- Visual attention methods in deep learning: An in-depth surveyInformation Fusion, 2024
- RTIDS: A Robust Transformer-Based Approach for Intrusion Detection SystemIEEE Access, 2022
- A Security Model Based on LightGBM and Transformer to Protect Healthcare Systems From CyberattacksIEEE Access, 2022
- Self-driving cars: A surveyExpert Systems with Applications, 2021
- Distributed Network Intrusion Detection System in Satellite-Terrestrial Integrated Networks Using Federated LearningIEEE Access, 2020
- Intelligent intrusion detection based on federated learning aided long short-term memoryPhysical Communication, 2020
- TON_IoT Telemetry Dataset: A New Generation Dataset of IoT and IIoT for Data-Driven Intrusion Detection SystemsIEEE Access, 2020
- Anomaly detection in mixed telemetry data using a sparse representation and dictionary learningSignal Processing, 2020
- A New Localization Objective for Accurate Fine-Grained Affordance Segmentation Under High-Scale VariationsIEEE Access, 2019