Chuanpeng Yang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Chuanpeng Yang has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Bingjie Yan
School of Optometry, The Hong Kong Polytechnic University, Kowloon, Hong Kong
1 shared publication - Chenlong Gao
Institute of Computing Technology, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing, China
1 shared publication - Fuqing Zhu
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China and School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
1 shared publication - Huaidan Zhang
RMIT University
1 shared publication Jicheng Deng
Leshan Academy of Agriculture Science, Leshan, Sichuan, China
1 shared publication- Jizhong Han
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 24 November 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 16 (6) , 1-27
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
Large Language Models (LLMs) have showcased exceptional capabilities in various domains, attracting significant interest from both academia and industry. Despite their impressive performance, the substantial size and computational demands of LLMs pose considerable challenges for practical deployment, particularly in environments with limited resources. The endeavor to compress language models while maintaining their accuracy has become a focal point of research. Among the various methods, knowledge distillation has emerged as an effective technique to enhance inference speed without greatly compromising performance. This article presents a thorough survey from three aspects: method, evaluation, and application, exploring knowledge distillation techniques tailored specifically for LLMs. Specifically, we divide the methods into white-box KD and black-box KD to better illustrate their differences. Furthermore, we also explored the evaluation tasks and distillation effects between different distillation methods and proposed directions for future research. Through in-depth understanding of the latest advancements and practical applications, this survey provides valuable resources for researchers, paving the way for sustained progress in this field.
- 24 November 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 16 (6) , 1-27
Top Cited PapersOpen AccessSurvey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
Large Language Models (LLMs) have showcased exceptional capabilities in various domains, attracting significant interest from both academia and industry. Despite their impressive performance, the substantial size and computational demands of LLMs pose considerable challenges for practical deployment, particularly in environments with limited resources. The endeavor to compress language models while maintaining their accuracy has become a focal point of research. Among the various methods, knowledge distillation has emerged as an effective technique to enhance inference speed without greatly compromising performance. This article presents a thorough survey from three aspects: method, evaluation, and application, exploring knowledge distillation techniques tailored specifically for LLMs. Specifically, we divide the methods into white-box KD and black-box KD to better illustrate their differences. Furthermore, we also explored the evaluation tasks and distillation effects between different distillation methods and proposed directions for future research. Through in-depth understanding of the latest advancements and practical applications, this survey provides valuable resources for researchers, paving the way for sustained progress in this field.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 4788-4797
Invariant Meets Specific: A Scalable Harmful Memes Detection Framework
Harmful memes detection is a challenging task in the field of multimodal information processing due to the semantic gap between different modalities. Current research on this task mainly focuses on multimodal dual-stream models. However, the existing works ignore the misalignment of the memes caused by the modality gap. Moreover, the cross-modal interaction in the dual-stream models is insufficient to identify harmful memes. To this end, this paper proposes a scalable invariant and specific modality (ISM) representations framework via graph neural networks. The proposed ISM framework provides a comprehensive and disentangled view for memes and promotes inter-modal interaction. Specifically, ISM projects each modality to two distinct spaces. The first space is modality-invariant, learning the corresponding commonalities and reducing the modality gap. The second space is modality-specific, holding the distinctive characteristics of each modality and complementing the common latent features captured in invariant spaces. Then, we construct fully connected visual and textual graphs for each space. The unimodal graphs are fused to dynamically balance inter-modal and intra-modal relationships, which are complementary to the dual-stream models. Finally, an adaptive module is designed to weigh the proportion of each fusion graph for memes. Moreover, the mainstream multimodal dual-stream models could be employed as the backbone flexibly. Extensive experiments on five publicly available datasets show that the proposed ISM provides a stable improvement over baselines and produces a competitive performance compared with the existing harmful memes detection methods.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 4788-4797
Open AccessInvariant Meets Specific: A Scalable Harmful Memes Detection Framework
Harmful memes detection is a challenging task in the field of multimodal information processing due to the semantic gap between different modalities. Current research on this task mainly focuses on multimodal dual-stream models. However, the existing works ignore the misalignment of the memes caused by the modality gap. Moreover, the cross-modal interaction in the dual-stream models is insufficient to identify harmful memes. To this end, this paper proposes a scalable invariant and specific modality (ISM) representations framework via graph neural networks. The proposed ISM framework provides a comprehensive and disentangled view for memes and promotes inter-modal interaction. Specifically, ISM projects each modality to two distinct spaces. The first space is modality-invariant, learning the corresponding commonalities and reducing the modality gap. The second space is modality-specific, holding the distinctive characteristics of each modality and complementing the common latent features captured in invariant spaces. Then, we construct fully connected visual and textual graphs for each space. The unimodal graphs are fused to dynamically balance inter-modal and intra-modal relationships, which are complementary to the dual-stream models. Finally, an adaptive module is designed to weigh the proportion of each fusion graph for memes. Moreover, the mainstream multimodal dual-stream models could be employed as the backbone flexibly. Extensive experiments on five publicly available datasets show that the proposed ISM provides a stable improvement over baselines and produces a competitive performance compared with the existing harmful memes detection methods.
- Open Access
- 28 March 2023
- Published by Frontiers Media SA in Frontiers in Veterinary Science
- Vol. 10, 1157935
Use of fermented Chinese medicine residues as a feed additive and effects on growth performance, meat quality, and intestinal health of broilers
Introduction: The purpose of this research was to investigate how dietary supplementation with fermented herbal residues (FCMR) affected birds' development capacity, quality of meat, gut barrier, and cecum microbiota.Methods: 540 cyan-shank partridge birds aged 47 days were chosen and divided into two groups of six replicates each and 45 birds for each replicate. The control group (CON) received a basal diet, while the trial group decreased a basic diet containing 5% FCMR.Results and discussion: The findings revealed that the addition of FCMR decreased FCR and increased ADG in broilers (P < 0.05). Adding FCMR increased steaming loss in broiler chicken breasts (p < 0.05). Supplementation with FCMR significantly enhanced VH/CD and VH in the bird's intestine (jejunum, duodenum, and ileum) (p < 0.05). In addition, the addition of FCMR significantly down-regulated mRNA expression of INF-γ, IL-6, IL-1β, and TNF-α and up-regulated mRNA expression of ZO-1, Occludin, and Claudin (P < 0.05). Microbial 16S rDNA high-throughput sequencing study revealed that supplements with FCMR modified the cecum microbiota, and α-diversity analysis showed that supplementation with FCMR reduced the cecum bacterial abundance in broilers (P < 0.05). At the phylum level, the relative abundance of Spirochaetota increased considerably following FCMR supplementation (P < 0.05). The broiler cecum's close lot of Prevotellaceae_UCG-001 (P < 0.05), Desulfovibrio, Muribaculaceae, and Fusobacterium (p < 0.05) reduced when FCMR was supplemented. Supplementation with FCMR can promote growth capacity and maintain intestinal health in birds by enhancing gut barrier function and modulating the inflammatory response and microbial composition.
- 28 March 2023
- Published by Frontiers Media SA in Frontiers in Veterinary Science
- Vol. 10, 1157935
Open AccessUse of fermented Chinese medicine residues as a feed additive and effects on growth performance, meat quality, and intestinal health of broilers
Introduction: The purpose of this research was to investigate how dietary supplementation with fermented herbal residues (FCMR) affected birds' development capacity, quality of meat, gut barrier, and cecum microbiota.Methods: 540 cyan-shank partridge birds aged 47 days were chosen and divided into two groups of six replicates each and 45 birds for each replicate. The control group (CON) received a basal diet, while the trial group decreased a basic diet containing 5% FCMR.Results and discussion: The findings revealed that the addition of FCMR decreased FCR and increased ADG in broilers (P < 0.05). Adding FCMR increased steaming loss in broiler chicken breasts (p < 0.05). Supplementation with FCMR significantly enhanced VH/CD and VH in the bird's intestine (jejunum, duodenum, and ileum) (p < 0.05). In addition, the addition of FCMR significantly down-regulated mRNA expression of INF-γ, IL-6, IL-1β, and TNF-α and up-regulated mRNA expression of ZO-1, Occludin, and Claudin (P < 0.05). Microbial 16S rDNA high-throughput sequencing study revealed that supplements with FCMR modified the cecum microbiota, and α-diversity analysis showed that supplementation with FCMR reduced the cecum bacterial abundance in broilers (P < 0.05). At the phylum level, the relative abundance of Spirochaetota increased considerably following FCMR supplementation (P < 0.05). The broiler cecum's close lot of Prevotellaceae_UCG-001 (P < 0.05), Desulfovibrio, Muribaculaceae, and Fusobacterium (p < 0.05) reduced when FCMR was supplemented. Supplementation with FCMR can promote growth capacity and maintain intestinal health in birds by enhancing gut barrier function and modulating the inflammatory response and microbial composition.