Shuang Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Shuang Wang has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Fuli Wu
Zhejiang University of Technology, Hangzhou, Zhejiang, China
3 shared publications - Pengyi Hao
Zhejiang University of Technology, Hangzhou, China
3 shared publications Bin Chen
1 shared publication- Cong Bai
Zhejiang University of Technology
1 shared publication Fuli Wu
1 shared publication- Haigen Hu
Zhejiang University of Technology
1 shared publication
Latest Publications
- 18 September 2026
- Published by Elsevier in Artificial Intelligence in Medicine
- Vol. 182
CReaTe-LM: A large language model for stepwise, heuristic clinical reasoning instruction
- 18 September 2026
- Published by Elsevier in Artificial Intelligence in Medicine
- Vol. 182
CReaTe-LM: A large language model for stepwise, heuristic clinical reasoning instruction
- 17 July 2026
- Published by Elsevier in Knowledge-Based Systems
- Vol. 351
Feature-based decoupled distillation
- 17 July 2026
- Published by Elsevier in Knowledge-Based Systems
- Vol. 351
Feature-based decoupled distillation
- 7 July 2026
- Published by Elsevier in Neural Networks
- Vol. 205 (Pt A) , 109336
Unified knowledge distillation: Integrating offline, online, and self-distillation paradigms for image classification
- 7 July 2026
- Published by Elsevier in Neural Networks
- Vol. 205 (Pt A) , 109336
Unified knowledge distillation: Integrating offline, online, and self-distillation paradigms for image classification
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 3028-3036
Live on the Hump: Self Knowledge Distillation via Virtual Teacher-Students Mutual Learning
For solving the limitations of the current self knowledge distillation including never fully utilizing the knowledge of shallow exits and neglecting the impact of auxiliary exits' structure on the performance of network, a novel self knowledge distillation framework via virtual teacher-students mutual learning named LOTH is proposed in this paper. A knowledgeable virtual teacher is constructed from the rich feature maps of each exit to help the learning of each exit. Meanwhile, the logit knowledges of each exit are incorporated to guide the learning of the virtual teacher. They learn mutually through the well-designed loss in LOTH. Moreover, two kinds of auxiliary building blocks are designed to balance the efficiency and effectiveness of network. Extensive experiments with diverse backbones on CIFAR-100 and Tiny-ImageNet validate the effectiveness of LOTH, which realizes superior performance with less resource by the comparison with the state-of-the-art distillation methods. The code of LOTH is available on Github https://github.com/cloak-s/LOTH.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 3028-3036
Open AccessLive on the Hump: Self Knowledge Distillation via Virtual Teacher-Students Mutual Learning
For solving the limitations of the current self knowledge distillation including never fully utilizing the knowledge of shallow exits and neglecting the impact of auxiliary exits' structure on the performance of network, a novel self knowledge distillation framework via virtual teacher-students mutual learning named LOTH is proposed in this paper. A knowledgeable virtual teacher is constructed from the rich feature maps of each exit to help the learning of each exit. Meanwhile, the logit knowledges of each exit are incorporated to guide the learning of the virtual teacher. They learn mutually through the well-designed loss in LOTH. Moreover, two kinds of auxiliary building blocks are designed to balance the efficiency and effectiveness of network. Extensive experiments with diverse backbones on CIFAR-100 and Tiny-ImageNet validate the effectiveness of LOTH, which realizes superior performance with less resource by the comparison with the state-of-the-art distillation methods. The code of LOTH is available on Github https://github.com/cloak-s/LOTH.