Serve Programs, Not Prompts
Open Access
- 14 May 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 179-186
Abstract
No abstract availableAll Related Versions
Funding Information
- National Science Foundation (2112562)
This publication has 10 references indexed in Scilit:
- Fast State Restoration in LLM Serving with HCache2025
- CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving2024
- Solving olympiad geometry without human demonstrationsNature, 2024
- Efficient Memory Management for Large Language Model Serving with PagedAttention2023
- Prompting Is Programming: A Query Language for Large Language ModelsProceedings of the ACM on Programming Languages, 2023
- Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning2023
- Recursion of Thought: A Divide-and-Conquer Approach to Multi-Context Reasoning with Language Models2023
- AST-trans2022
- P4ACM SIGCOMM Computer Communication Review, 2014
- Extensibility safety and performance in the SPIN operating system1995