Teaching Small Language Models Reasoning through Counterfactual Distillation
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 5831-5842
Abstract
Tao Feng, Yicheng Li, Li Chenglin, Hao Chen, Fei Yu, Yin Zhang. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.Keywords
This publication has 17 references indexed in Scilit:
- Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations2023
- Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step2023
- Large Language Models Are Reasoning Teachers2023
- CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation2022
- Tailor: Generating and Perturbing Text with Semantic Controls2022
- DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation2022
- Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models2021
- Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA2021
- More Bang for Your Buck: Natural Perturbation for Robust Question Answering2020
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020