Akihiro Fujii
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Akihiro Fujii has a total of 1 co-authors. Here are the top co-authors by number of shared publications:
- Kun Xiang
Department of Science and Engineering, Hosei University, Tokyo 184-8584, Japan
1 shared publication
Latest Publications
- 4 June 2026
- Published by World Scientific Pub Co Pte Ltd in International Journal of Semantic Computing
- Vol. 20 (02) , 227-248
Progressive Learning-to-Learn Knowledge Distillation for Robust Out-of-Domain Generalization
Knowledge distillation (KD) plays a crucial role in reducing computational costs, accelerating inference, and improving model generalization. However, when there is a significant capacity gap between teacher and student networks, KD often struggles to transfer knowledge effectively, and robustness under distribution shifts remains a major challenge. To address these issues, we propose learning-to-learn knowledge distillation (L2L-KD), a dynamic temperature-controlled KD framework that progressively increases learning difficulty, mimicking how human learners advance from basic to complex concepts. To further enhance robustness and generalization, we introduce a counterfactual data augmentation technique that leverages the Metropolis–Hastings algorithm to generate fluent and semantically coherent out-of-domain (OOD) samples. We evaluate L2L-KD across in-domain, OOD, and adversarial scenarios, and the results show that it consistently outperforms existing KD approaches while substantially improving robustness. Moreover, building upon this foundation, we extend the core learning philosophy to a new unsupervised cross-domain framework, demonstrating that the dynamic distillation principles of L2L-KD can naturally generalize to broader domain adaptation tasks.
- 4 June 2026
- Published by World Scientific Pub Co Pte Ltd in International Journal of Semantic Computing
- Vol. 20 (02) , 227-248
Progressive Learning-to-Learn Knowledge Distillation for Robust Out-of-Domain Generalization
Knowledge distillation (KD) plays a crucial role in reducing computational costs, accelerating inference, and improving model generalization. However, when there is a significant capacity gap between teacher and student networks, KD often struggles to transfer knowledge effectively, and robustness under distribution shifts remains a major challenge. To address these issues, we propose learning-to-learn knowledge distillation (L2L-KD), a dynamic temperature-controlled KD framework that progressively increases learning difficulty, mimicking how human learners advance from basic to complex concepts. To further enhance robustness and generalization, we introduce a counterfactual data augmentation technique that leverages the Metropolis–Hastings algorithm to generate fluent and semantically coherent out-of-domain (OOD) samples. We evaluate L2L-KD across in-domain, OOD, and adversarial scenarios, and the results show that it consistently outperforms existing KD approaches while substantially improving robustness. Moreover, building upon this foundation, we extend the core learning philosophy to a new unsupervised cross-domain framework, demonstrating that the dynamic distillation principles of L2L-KD can naturally generalize to broader domain adaptation tasks.