Debias Fine-Grained Radical Modeling via Global-Local Attention Mutual Learning for Zero-Shot Chinese Character Recognition
- 15 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. PP (15209210) , 1-15
Abstract
In zero-shot Chinese character recognition (ZSCCR), radicals play a critical bridge for transferring semantic knowledge from seen to unseen characters. However, existing radical-based approaches tend to coarsely map Chinese character images to radical embeddings, disregarding the imperative for fine-grained radical learning and the prevalent imbalanced issue among radicals. This leads to underemphasizing less frequent radicals or introducing bias towards more prevalent ones. To address this, we propose a novel framework of Debiasing fine-grained Radical Modeling via Global-Local radical attention mutual learning for ZSCCR, termed DeRMGL. DeRMGL features two branches for global and local radical modeling. The multi-local branch partitions learnable radical prototypes into non-overlapping blocks by frequency, each with a dedicated attention network. Since radicals in each block have similar occurrence frequencies, attention scores are less skewed by frequency disparities, effectively alleviating radical imbalance. The global branch maintains full radical coverage to coordinate holistic semantic scoring. During training, mutual learning loss optimizes both branches collaboratively, and during inference, their predictions are combined. Furthermore, an enhanced Radical Prototype-based Attention (RPA) network serves as the backbone to leverage visual-semantic knowledge. Extensive experiments on four ZSCCR benchmark datasets demonstrate that DeRMGL achieves state-of-the-art performance.Keywords
Funding Information
- Open Project of the State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS2024101)
- Natural Science Foundation of Xiamen (3502Z202373058)
- Unveiling and Leading Projects of Xiamen (3502Z20241011)
- Major Science and Technology Plan Project on the Future Industry Fields of Xiamen City (3502Z20241027)
- National Natural Science Foundation of China (62222609)
- Type 2030 Green and Intelligent Ship in the Fujian region (CBG4N21-4-4)
This publication has 44 references indexed in Scilit:
- Learning Explicit Radical Representations for Zero-Shot Chinese Character Recognition2024
- Dynamic collaborative learning with heterogeneous knowledge transfer for long-tailed visual recognitionInformation Fusion, 2024
- Federated deep long-tailed learning: A surveyNeurocomputing, 2024
- Chinese character recognition with radical-structured stroke treesMachine Learning, 2023
- Deep mutual learning for visual object trackingPattern Recognition, 2021
- Zero-shot Handwritten Chinese Character Recognition with hierarchical decomposition embeddingPattern Recognition, 2020
- Deep Matching Network for Handwritten Chinese Character RecognitionPattern Recognition, 2020
- Radical analysis network for learning hierarchies of Chinese charactersPattern Recognition, 2020
- A Large Chinese Text Dataset in the WildJournal of Computer Science and Technology, 2019
- An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild2016