LLM4DV: Using Large Language Models for Hardware Test Stimuli Generation
Authors:
Top Cited Papers
- 4 May 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 133-137
Abstract
Hardware design verification (DV) is a process that checks the functional equivalence of a hardware design against its specifications, improving hardware reliability and robustness. A key task in the DV process is the test stimuli generation, which creates a set of conditions or inputs for testing. These test conditions are often complex and specific to the given hardware design, requiring substantial human engineering effort to optimize. We seek a solution of automated and efficient testing for arbitrary hardware designs that takes advantage of large language models (LLMs). LLMs have already shown promising results for improving hardware design automation, but remain under-explored for hardware DV. In this paper, we propose an open-source benchmarking framework named LLM4DV that efficiently orchestrates LLMs for automated hardware test stimuli generation. Our analysis evaluates six different LLMs involving six prompting improvements over eight hardware designs and provides insight for future work on LLMs development for efficient automated DV.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- RTLLM: An Open-Source Benchmark for Design RTL Generation with Large Language Model2024
- GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models2023
- Chip-Chat: Challenges and Opportunities in Conversational Hardware Design2023
- Data-Centric Machine Learning Pipeline for Hardware Verification2022
- BERT Representations for Video Question Answering2020
- Automated Test Generation for Activation of Assertions in RTL Models2020
- Airwolf-TG: A test generator for assertion-based dynamic verification2009
- Generation of test programs for the assertion-based verification of TLM models2008
- Accelerating Assertion Coverage With Adaptive TestbenchesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2008
- Coverage-directed test generation through automatic constraint extraction2007