A Thorough Examination of Decoding Methods in the Era of LLMs
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 8601-8629
Abstract
Chufan Shi, Haoran Yang, Deng Cai, Zhisong Zhang, Yifan Wang, Yujiu Yang, Wai Lam. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and AccelerationGetMobile: Mobile Computing and Communications, 2025
- Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks2024
- ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models2024
- PTD-SQL: Partitioning and Targeted Drilling with LLMs in Text-to-SQL2024
- Locally Typical SamplingTransactions of the Association for Computational Linguistics, 2023
- FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation2023
- On Decoding Strategies for Neural Text GeneratorsTransactions of the Association for Computational Linguistics, 2022
- Did Aristotle Use a Laptop?A Question Answering Benchmark with Implicit Reasoning StrategiesTransactions of the Association for Computational Linguistics, 2021
- DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts2021
- FUDGE: Controlled Text Generation With Future Discriminators2021