DeepVecFont
Authors:
Open Access
- 10 December 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 40 (6) , 1-15
Abstract
Automatic font generation based on deep learning has aroused a lot of interest in the last decade. However, only a few recently-reported approaches are capable of directly generating vector glyphs and their results are still far from satisfactory. In this paper, we propose a novel method, DeepVecFont, to effectively resolve this problem. Using our method, for the first time, visually-pleasing vector glyphs whose quality and compactness are both comparable to human-designed ones can be automatically generated. The key idea of our DeepVecFont is to adopt the techniques of image synthesis, sequence modeling and differentiable rasterization to exhaustively exploit the dual-modality information (i.e., raster images and vector outlines) of vector fonts. The highlights of this paper are threefold. First, we design a dual-modality learning strategy which utilizes both image-aspect and sequence-aspect features of fonts to synthesize vector glyphs. Second, we provide a new generative paradigm to handle unstructured data (e.g., vector glyphs) by randomly sampling plausible synthesis results to get the optimal one which is further refined under the guidance of generated structured data (e.g., glyph images). Finally, qualitative and quantitative experiments conducted on a publicly-available dataset demonstrate that our method obtains high-quality synthesis results in the applications of vector font generation and interpolation, significantly outperforming the state of the art.Keywords
Funding Information
- Beijing Nova Program of Science and Technology (Z191100001119077)
- PKU-Baidu Fund (2020BD020)
This publication has 16 references indexed in Scilit:
- EasyFontACM Transactions on Graphics, 2018
- Multi-content GAN for Few-Shot Font Style Transfer2018
- Multimodal Machine Learning: A Survey and TaxonomyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- DCFont2017
- Multi-modal Factorized Bilinear Pooling with Co-attention Learning for Visual Question Answering2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Learning a manifold of fontsACM Transactions on Graphics, 2014
- Long Short-Term MemoryNeural Computation, 1997