Arguzz: Testing zkVMs for Soundness and Completeness Bugs
Preprint
Abstract
Zero-knowledge virtual machines (zkVMs) are increasingly deployed in decentralized applications and blockchain rollups since they enable verifiable off-chain computation. These VMs execute general-purpose programs, frequently written in Rust, and produce succinct cryptographic proofs. However, zkVMs are complex, and bugs in their constraint systems or execution logic can cause critical soundness (accepting invalid executions) or completeness (rejecting valid ones) issues. We present Arguzz, the first automated tool for testing zkVMs for soundness and completeness bugs. To detect such bugs, Arguzz combines a novel variant of metamorphic testing with fault injection. In particular, it generates semantically equivalent program pairs, merges them into a single Rust program with a known output, and runs it inside a zkVM. By injecting faults into the VM, Arguzz mimics malicious or buggy provers to uncover overly weak constraints. We used Arguzz to test six real-world zkVMs (RISC Zero, Nexus, Jolt, SP1, OpenVM, and Pico) and found eleven bugs in three of them. One RISC Zero bug resulted in a $50,000 bounty, despite prior audits, demonstrating the critical need for systematic testing of zkVMs.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Jolt: SNARKs for Virtual Machines via Lookups2024
- Dory: Efficient, Transparent Arguments for Generalised Inner Products and Polynomial Commitments2021
- IFIZZ: Deep-State and Efficient Fault-Scenario Generation to Test IoT Firmware2021
- Relational Verification Using Product Programs2011
- Mining API Error-Handling Specifications from Source Code2009
- Secure Information Flow as a Safety Problem2005
- Secure information flow by self-composition2004
- Fault injection techniques and toolsComputer, 1997
- Fault injection: a method for validating computer-system dependabilityComputer, 1995
- Fault injection for dependability validation: a methodology and some applicationsIEEE Transactions on Software Engineering, 1990