Domain-Adapted LLMs for VLSI Design and Verification: A Case Study on Formal Verification
Authors:
- 22 April 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-4
Abstract
Large language models (LLMs) present unprecedented opportunities in task automation for industrial chip design and verification that can yield significant improvements in engineering productivity. Instead of deploying off-the-shelf LLMs, we present our methodology for adapting a language model to the domain of VLSI design, and we show that our domain-adapted model, ChipNeMo, achieves improved performance against models of similar size on benchmarks concerning chip design and electronic design automation (EDA). We finally present a case study on the prospective of applying LLMs to hardware formal verification. Our results indicate that the largest and most capable models, such as GPT-4, are able to generate syntactically correct SVA implementations, yet there exists room for improvement in ensuring precise reflection of user intent given as high-level natural language descriptions of formal properties.Keywords
This publication has 8 references indexed in Scilit:
- VeriGen: A Large Language Model for Verilog Code GenerationACM Transactions on Design Automation of Electronic Systems, 2024
- LLM-Guided Formal Verification Coupled with Mutation Testing2024
- Invited Paper: VerilogEval: Evaluating Large Language Models for Verilog Code Generation2023
- Chip-Chat: Challenges and Opportunities in Conversational Hardware Design2023
- 14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathonDigital Discovery, 2023
- DAVE: Deriving Automatically Verilog from English2020
- Automated Assertion Generation from Natural Language Specifications2020
- Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks2020