Tokengrid: Toward More Efficient Data Extraction From Unstructured Documents
Open Access
- 4 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 39261-39268
Abstract
Key information extraction from unstructured documents is a practical problem in many industries. Machine learning models aimed at solving this problem should efficiently utilize textual, visual, and 2D spatial layout information of the document. Grid based approaches achieve this by representing the document as a 2D grid and feeding it to a fully convolutional encoder-decoder network that solves a semantic instance segmentation problem. We propose a new method for the instance detection branch of that network for the task of automatic information extraction from invoices. Our approach reduces this problem to 1D region detection. The proposed network has fewer parameters and a shorter inference times. Additionally, we suggest a new metric for evaluating the results.Keywords
This publication has 16 references indexed in Scilit:
- ViBERTgrid: A Jointly Trained Multi-modal 2D Document Representation for Key Information Extraction from Documents2021
- TRIE: End-to-End Text Reading and Information Extraction for Document Understanding2020
- LayoutLM: Pre-training of Text and Layout for Document Image Understanding2020
- Character Region Awareness for Text Detection2019
- Path Aggregation Network for Instance Segmentation2018
- Minimum Word Error Rate Training for Attention-Based Sequence-to-Sequence Models2018
- CloudScan - A Configuration-Free Invoice Analysis System Using Recurrent Neural Networks2017
- Mask R-CNN2017
- The Importance of Skip Connections in Biomedical Image Segmentation2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016