AFAkihiro Fujii

Akihiro Fujii

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Akihiro Fujii has a total of 1 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Progressive Learning-to-Learn Knowledge Distillation for Robust Out-of-Domain Generalization

    by Kun Xiang, Akihiro Fujii

    Knowledge distillation (KD) plays a crucial role in reducing computational costs, accelerating inference, and improving model generalization. However, when there is a significant capacity gap between teacher and student networks, KD often struggles to transfer knowledge effectively, and robustness under distribution shifts remains a major challenge. To address these issues, we propose learning-to-learn knowledge distillation (L2L-KD), a dynamic temperature-controlled KD framework that progressively increases learning difficulty, mimicking how human learners advance from basic to complex concepts. To further enhance robustness and generalization, we introduce a counterfactual data augmentation technique that leverages the Metropolis–Hastings algorithm to generate fluent and semantically coherent out-of-domain (OOD) samples. We evaluate L2L-KD across in-domain, OOD, and adversarial scenarios, and the results show that it consistently outperforms existing KD approaches while substantially improving robustness. Moreover, building upon this foundation, we extend the core learning philosophy to a new unsupervised cross-domain framework, demonstrating that the dynamic distillation principles of L2L-KD can naturally generalize to broader domain adaptation tasks.