Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 12042-12059
Abstract
Jacob K Christopher, Brian R. Bartoldson, Tal Ben-Nun, Michael Cardei, Bhavya Kailkhura, Ferdinando Fioretto. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing Surveys, 2025
- SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification2024
- SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices2024
- Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding2024
- The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMs2023
- SpecTr: Fast Speculative Decoding via Optimal Transport2023
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena2023
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness2022
- Mask-Predict: Parallel Decoding of Conditional Masked Language Models2019
- Scheduling multithreaded computations by work stealingJournal of the ACM, 1999