CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation
Top Cited Papers
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 677-693
Abstract
Zhenyi Shen, Hanqi Yan, Linhai Zhang, Zhanghao Hu, Yali Du, Yulan He. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- 500xCompressor: Generalized Prompt Compression for Large Language Models2025
- SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs2025
- UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models2025
- What Formal Languages Can Transformers Express? A SurveyTransactions of the Association for Computational Linguistics, 2024
- Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning2024
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes2023
- Self-Instruct: Aligning Language Models with Self-Generated Instructions2023
- Large Language Models Are Reasoning Teachers2023
- Knowledge Distillation: A SurveyInternational Journal of Computer Vision, 2021
- Are NLP Models really able to Solve Simple Math Word Problems?2021