Cross-Domain Document Object Detection: Benchmark Suite and Method
Preprint
Abstract
Decomposing images of document pages into high-level semantic regions (e.g., figures, tables, paragraphs), document object detection (DOD) is fundamental for downstream tasks like intelligent document editing and understanding. DOD remains a challenging problem as document objects vary significantly in layout, size, aspect ratio, texture, etc. An additional challenge arises in practice because large labeled training datasets are only available for domains that differ from the target domain. We investigate cross-domain DOD, where the goal is to learn a detector for the target domain using labeled data from the source domain and only unlabeled data from the target domain. Documents from the two domains may vary significantly in layout, language, and genre. We establish a benchmark suite consisting of different types of PDF document datasets that can be utilized for cross-domain DOD model training and evaluation. For each dataset, we provide the page images, bounding box annotations, PDF files, and the rendering layers extracted from the PDF files. Moreover, we propose a novel cross-domain DOD model which builds upon the standard detection model and addresses domain shifts by incorporating three novel alignment modules: Feature Pyramid Alignment (FPA) module, Region Alignment (RA) module and Rendering Layer alignment (RLA) module. Extensive experiments on the benchmark suite substantiate the efficacy of the three proposed modules and the proposed method significantly outperforms the baseline methods. The project page is at \url{https://github.com/kailigo/cddod}.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Adapting Object Detectors via Selective Cross-Domain Alignment2019
- Strong-Weak Distribution Alignment for Adaptive Object Detection2019
- Automatic Adaptation of Object Detectors to New Domains Using Self-Training2019
- Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detection2019
- Domain Adaptive Faster R-CNN for Object Detection in the Wild2018
- Cross-Domain Weakly-Supervised Object Detection Through Progressive Domain Adaptation2018
- Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networks2017
- Context Encoders: Feature Learning by Inpainting2016
- Deep Residual Learning for Image Recognition2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016