Handwritten Character Image Generation for Effective Data Augmentation
Open Access
- 1 January 2025
- journal article
- Published by Institute of Electronics, Information and Communications Engineers (IEICE) in IEICE Transactions on Information and Systems
Abstract
This study introduces data augmentation techniques to enhance training datasets for a Japanese handwritten character classification model, addressing the high cost of collecting extensive handwritten character data. A novel method is proposed to automatically generate a largescale dataset of handwritten characters from a smaller dataset, utilizing a style transformation approach, particularly Adaptive Instance Normalization (AdaIN).Additionally, the study presents an innovative technique to improve character structural information by integrating features from the Contrastive Language-Image Pre-training (CLIP) text encoder. This approach enables the creation of diverse handwritten character images, including Kanji, by merging content and style elements. The effectiveness of our approach is demonstrated by evaluating a handwritten character classification model using an expanded dataset, which includes Japanese hiragana, katakana, and Kanji from the ETL Character Database. The character classification model's macro F1 score improved from 0.9733 with the original dataset to 0.9861 using the augmented dataset by the proposed approach. This result indicated that our proposed character generation model was able to generate new character images that were not included in the original dataset and that they effectively contributed to training the handwritten character classification model.Keywords
This publication has 26 references indexed in Scilit:
- Data Augmentation with Automatically Generated Images for Character Classifier Model Training2023
- Conditional Text Image Generation with Diffusion Models2023
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- Y-Autoencoders: Disentangling latent representations via sequential encodingPattern Recognition Letters, 2020
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- The IAM-database: an English sentence database for offline handwriting recognitionInternational Journal on Document Analysis and Recognition (IJDAR), 2002
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998