M6Doc: A Large-Scale Multi-Format, Multi-Type, Multi-Layout, Multi-Language, Multi-Annotation Category Dataset for Modern Document Layout Analysis
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 15138-15147
Abstract
Document layout analysis is a crucial prerequisite for document understanding, including document retrieval and conversion. Most public datasets currently contain only PDF documents and lack realistic documents. Models trained on these datasets may not generalize well to real-world scenarios. Therefore, this paper introduces a large and diverse document layout analysis dataset called M 6 Doc. The M6 designation represents six properties: (1) Multi-Format (including scanned, photographed, and PDF documents); (2) Multi-Type (such as scientific articles, textbooks, books, test papers, magazines, newspapers, and notes); (3) Multi-Layout (rectangular, Manhattan, non-Manhattan, and multi-column Manhattan); (4) Multi-Language (Chinese and English); (5) Multi-Annotation Category (74 types of annotation labels with 237,116 annotation instances in 9,080 manually annotated pages); and (6) Modern documents. Additionally, we propose a transformer-based document layout analysis method called TransDLANet, which leverages an adaptive element matching mechanism that enables query embedding to better match ground truth to improve recall, and constructs a segmentation branch for more precise document image instance segmentation. We conduct a comprehensive evaluation of M 6 Doc with various layout analysis methods and demonstrate its effectiveness. TransDLANet achieves state-of-the-art performance on M6 Doc with 64.5% mAP. The M 6 Doc dataset will be available at https://github.com/HcIILAB/M6Doc.Keywords
All Related Versions
Funding Information
- NSFC (61936003)
This publication has 35 references indexed in Scilit:
- Focal Loss for Dense Object Detection2017
- Mask R-CNN2017
- Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networks2017
- BCE-Arabic-v1 dataset2016
- A general approach for multi-oriented text line extraction of handwritten documentsInternational Journal on Document Analysis and Recognition (IJDAR), 2011
- Document Structure and Layout Analysis2007
- Segmentation of Page Images Using the Area Voronoi DiagramComputer Vision and Image Understanding, 1998
- The document spectrum for page layout analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- A prototype document image analysis system for technical journalsComputer, 1992
- Document Analysis SystemIBM Journal of Research and Development, 1982