MataDoc: Margin and Text Aware Document Dewarping for Arbitrary Boundary
Preprint
Abstract
Document dewarping from a distorted camera-captured image is of great value for OCR and document understanding. The document boundary plays an important role which is more evident than the inner region in document dewarping. Current learning-based methods mainly focus on complete boundary cases, leading to poor document correction performance of documents with incomplete boundaries. In contrast to these methods, this paper proposes MataDoc, the first method focusing on arbitrary boundary document dewarping with margin and text aware regularizations. Specifically, we design the margin regularization by explicitly considering background consistency to enhance boundary perception. Moreover, we introduce word position consistency to keep text lines straight in rectified document images. To produce a comprehensive evaluation of MataDoc, we propose a novel benchmark ArbDoc, mainly consisting of document images with arbitrary boundaries in four typical scenarios. Extensive experiments confirm the superiority of MataDoc with consideration for the incomplete boundary on ArbDoc and also demonstrate the effectiveness of the proposed method on DocUNet, DIR300, and WarpDoc datasets.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- TextFormer: A Query-based End-to-end Text Spotter with Mixed SupervisionMachine Intelligence Research, 2024
- Revisiting Document Image Dewarping by Grid Regularization2022
- Fourier Document Restoration for Robust Document Dewarping and Recognition2022
- Dewarping of document images: A semi-CNN based approachMultimedia Tools and Applications, 2021
- A theoretical justification of warping generation for dewarping using CNNPattern Recognition, 2021
- ICDAR2019 Competition on Scanned Receipt OCR and Information Extraction2019
- FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents2019
- A Book Dewarping System by Boundary-Based 3D Surface Reconstruction2013
- A Tutorial on the Cross-Entropy MethodAnnals of Operations Research, 2005
- Rectifying the bound document image captured by the camera: a model based approach2004