Zhe Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhe Wang has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Fengbo Zheng
College of Computer and Information Engineering, Tianjin Normal University, Tianjin 300387, China
1 shared publication - Fuxiao Ma
College of Computer and Information Engineering Tianjin Normal University, Tianjin 300387, P. R. China
1 shared publication - Linlin Shan
College of Computer and Information Engineering Tianjin Normal University, Tianjin 300387, P. R. China
1 shared publication - Long Zhang
College of Computer and Information Engineering Tianjin Normal University, Tianjin 300387, P. R. China
1 shared publication
Latest Publications
- 31 August 2026
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- p. 1-21
PD-CoTD: A Prefix-Description Enhanced CoT Distillation Framework for Improving Mathematical Reasoning in Small Language Models
Large Language Models (LLMs) have strong capabilities in mathematical and logical reasoning. However, deploying LLMs is difficult for users with limited hardware. One solution is distilling reasoning skills from LLMs to Small Language Models (SLMs, ≤1B parameters). Still, student models often make five common errors: calculation errors, missing reasoning steps, symbol mistakes, semantic misunderstandings and coherence errors. This paper proposes Prefix-Description-CoTD (PD-CoTD), an improved distillation method to address these issues. First, structured prompt templates guide LLMs to generate complete reasoning steps. This creates high-quality datasets to help SLMs learn effective reasoning patterns. Second, we introduce a step-by-step optimization loss function. This loss function separates reasoning path modeling from final answer prediction. It helps the model focus on reasoning clearly while optimizing results. Experimental results show that PD-CoTD significantly enhances the mathematical reasoning abilities of SLMs. It achieves state-of-the-art performance and greatly reduces the five common errors. PD-CoTD provides an effective solution for deploying powerful reasoning in resource-constrained environments. It also supports the broader application of lightweight models in academic research and education. Our code implementation and data are available at https://github.com/gameking2159/PD-CoTD.
- 31 August 2026
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- p. 1-21
PD-CoTD: A Prefix-Description Enhanced CoT Distillation Framework for Improving Mathematical Reasoning in Small Language Models
Large Language Models (LLMs) have strong capabilities in mathematical and logical reasoning. However, deploying LLMs is difficult for users with limited hardware. One solution is distilling reasoning skills from LLMs to Small Language Models (SLMs, ≤1B parameters). Still, student models often make five common errors: calculation errors, missing reasoning steps, symbol mistakes, semantic misunderstandings and coherence errors. This paper proposes Prefix-Description-CoTD (PD-CoTD), an improved distillation method to address these issues. First, structured prompt templates guide LLMs to generate complete reasoning steps. This creates high-quality datasets to help SLMs learn effective reasoning patterns. Second, we introduce a step-by-step optimization loss function. This loss function separates reasoning path modeling from final answer prediction. It helps the model focus on reasoning clearly while optimizing results. Experimental results show that PD-CoTD significantly enhances the mathematical reasoning abilities of SLMs. It achieves state-of-the-art performance and greatly reduces the five common errors. PD-CoTD provides an effective solution for deploying powerful reasoning in resource-constrained environments. It also supports the broader application of lightweight models in academic research and education. Our code implementation and data are available at https://github.com/gameking2159/PD-CoTD.