RuleGenie: SIEM Detection Rule Set Optimization
Authors:
- Yuval EloviciYEYuval Elovici
- Asaf ShabtaiASAsaf Shabtai
Preprint
Abstract
SIEM systems serve as a critical hub, employing rule-based logic to detect and respond to threats. Redundant or overlapping rules in SIEM systems lead to excessive false alerts, degrading analyst performance due to alert fatigue, and increase computational overhead and response latency for actual threats. As a result, optimizing SIEM rule sets is essential for efficient operations. Despite the importance of such optimization, research in this area is limited, with current practices relying on manual optimization methods that are both time-consuming and error-prone due to the scale and complexity of enterprise-level rule sets. To address this gap, we present RuleGenie, a novel large language model (LLM) aided recommender system designed to optimize SIEM rule sets. Our approach leverages transformer models' multi-head attention capabilities to generate SIEM rule embeddings, which are then analyzed using a similarity matching algorithm to identify the top-k most similar rules. The LLM then processes the rules identified, utilizing its information extraction, language understanding, and reasoning capabilities to analyze rule similarity, evaluate threat coverage and performance metrics, and deliver optimized recommendations for refining the rule set. By automating the rule optimization process, RuleGenie allows security teams to focus on more strategic tasks while enhancing the efficiency of SIEM systems and strengthening organizations' security posture. We evaluated RuleGenie on a comprehensive set of real-world SIEM rule formats, including Splunk, Sigma, and AQL (Ariel query language), demonstrating its platform-agnostic capabilities and adaptability across diverse security infrastructures. Our experimental results show that RuleGenie can effectively identify redundant rules, which in turn decreases false positive rates and enhances overall rule efficiency.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- GPT-4o: The Cutting-Edge Advancement in Multimodal LLM2025
- LLM for SoC Security: A Paradigm ShiftIEEE Access, 2024
- Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies2024
- SecBERT: Privacy-preserving pre-training based neural network inference systemNeural Networks, 2024
- LogGPT: Log Anomaly Detection via GPT2023
- LAnoBERT: System log anomaly detection based on BERT masked language modelApplied Soft Computing, 2023
- A Survey on Human-in-the-Loop Applications Towards an Internet of AllIEEE Communications Surveys & Tutorials, 2015
- The Operational Role of Security Information and Event Management SystemsIEEE Security & Privacy, 2014
- Complete Redundancy Removal for Packet Classifiers in TCAMsIEEE Transactions on Parallel and Distributed Systems, 2008
- Specifying graceful degradationIEEE Transactions on Parallel and Distributed Systems, 1991