MARVEL: Multi-Agent RTL Vulnerability Extraction using Large Language Models
Authors:
- Luca ColliniLCLuca Collini
- Baleegh AhmadBABaleegh Ahmad
- Joey Ah-KiowJAJoey Ah-Kiow
- Ramesh KarriRKRamesh Karri
Preprint
Abstract
Hardware security verification is a challenging and time-consuming task. For this purpose, design engineers may utilize tools such as formal verification, linters, and functional simulation tests, coupled with analysis and a deep understanding of the hardware design being inspected. Large Language Models (LLMs) have been used to assist during this task, either directly or in conjunction with existing tools. We improve the state of the art by proposing MARVEL, a multi-agent LLM framework for a unified approach to decision-making, tool use, and reasoning. MARVEL mimics the cognitive process of a designer looking for security vulnerabilities in RTL code. It consists of a supervisor agent that devises the security policy of the system-on-chips (SoCs) using its security documentation. It delegates tasks to validate the security policy to individual executor agents. Each executor agent carries out its assigned task using a particular strategy. Each executor agent may use one or more tools to identify potential security bugs in the design and send the results back to the supervisor agent for further analysis and confirmation. MARVEL includes executor agents that leverage formal tools, linters, simulation tests, LLM-based detection schemes, and static analysis-based checks. We test our approach on a known buggy SoC based on OpenTitan from the Hack@DATE competition. We find that 20 of the 48 issues reported by MARVEL pose security vulnerabilities.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Can Reasoning Models Reason about Hardware? An Agentic HLS Perspective2025
- SoCureLLM: An LLM-Driven Approach for Large-Scale System-on-Chip Security Verification and Policy Generation2025
- A survey on LLM-based multi-agent systems: workflow, infrastructure, and challengesVicinagearth, 2024
- A survey on large language model based autonomous agentsFrontiers of Computer Science, 2024
- LLM4SecHW: Leveraging Domain-Specific Large Language Model for Hardware Debugging2023
- Challenges and Opportunities for Practical and Effective Dynamic Information Flow TrackingACM Computing Surveys, 2021
- Hardware Information Flow TrackingACM Computing Surveys, 2021
- Hyperfuzzing for SoC security validation2020
- RTL bug localization through LTL specification mining (WIP)2019
- FinalFilter: Asserting Security Properties of a Processor at RuntimeIEEE Micro, 2019