Recognizing Vector Graphics without Rasterization
Preprint
Abstract
In this paper, we consider a different data format for images: vector graphics. In contrast to raster graphics which are widely used in image recognition, vector graphics can be scaled up or down into any resolution without aliasing or information loss, due to the analytic representation of the primitives in the document. Furthermore, vector graphics are able to give extra structural information on how low-level elements group together to form high level shapes or structures. These merits of graphic vectors have not been fully leveraged in existing methods. To explore this data format, we target on the fundamental recognition tasks: object localization and classification. We propose an efficient CNN-free pipeline that does not render the graphic into pixels (i.e. rasterization), and takes textual document of the vector graphics as input, called YOLaT (You Only Look at Text). YOLaT builds multi-graphs to model the structural and spatial information in vector graphics, and a dual-stream graph neural network is proposed to detect objects from the graph. Our experiments show that by directly operating on vector graphics, YOLaT out-performs raster-graphic based object detection baselines in terms of both average precision and efficiency.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud2020
- Fast multi-language LSTM-based online handwriting recognitionInternational Journal on Document Analysis and Recognition (IJDAR), 2020
- CornerNet: Detecting Objects as Paired KeypointsInternational Journal of Computer Vision, 2019
- ABC: A Big CAD Model Dataset for Geometric Deep Learning2019
- YOLO9000: Better, Faster, Stronger2017
- Deep Residual Learning for Image Recognition2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Symbol recognition using spatial relationsPattern Recognition Letters, 2012
- A structural representation for understanding line-drawing imagesInternational Journal on Document Analysis and Recognition (IJDAR), 2000