Toward Lightweight IoC Extraction in IoT: The Role of Small Language Models
Authors:
- 5 December 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
The proliferation of cyber threats necessitates rapid and accurate extraction of Indicators of Compromise (IoCs) from diverse security data sources. While Large Language Models (LLMs) have demonstrated exceptional capabilities in natural language processing and information extraction tasks, their deployment on resource-constrained IoT devices remains challenging due to computational and memory requirements. This paper investigates whether Small Language Models (SLMs) can serve as effective alternatives to LLMs for IoC extraction in IoT environments with limited resources. We present a novel direct LLM-based IoC extraction system leveraging context memory mechanisms for document-wide semantic understanding, specifically designed for deployment on edge computing infrastructure with consumer-grade hardware. Our experimental setup utilizes an RTX 4080 GPU and Ryzen 7 7700X processor running the Ollama framework with GPT-OSS:20B model to evaluate the feasibility of using smaller models instead of resource-intensive LLMs for security tasks. Evaluated on 9 diverse threat intelligence reports spanning different malware families and attack campaigns, the system achieved an average F1 score of 0.62, precision of 0.54, recall of 0.79, and accuracy of 0.85, demonstrating that SLMs can achieve acceptable accuracy levels for IoC extraction while operating within the computational constraints typical of IoT edge deployments. The results suggest that smaller models may provide viable alternatives to large language models for distributed threat intelligence processing in resource-limited environments.Keywords
This publication has 7 references indexed in Scilit:
- Malware Detection at the Edge with Lightweight LLMs: A Performance EvaluationACM Transactions on Internet Technology, 2026
- Intelligent data analysis in edge computing with large language models: applications, challenges, and future directionsFrontiers in Computer Science, 2025
- Empowering large language models to edge intelligence: A survey of edge efficient LLMs and techniquesComputer Science Review, 2025
- A Review on Edge Large Language Models: Design, Execution, and ApplicationsACM Computing Surveys, 2025
- Toward Edge General Intelligence via Large Language Models: Opportunities and ChallengesIEEE Network, 2025
- EdgeShard: Efficient LLM Inference via Collaborative Edge ComputingIEEE Internet of Things Journal, 2024
- Cyber threat indicators extraction based on contextual knowledge promptComputer Networks, 2024