End to End Invoice Processing Application Based on Key Fields Extraction
Author:
Open Access
- 21 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 78398-78413
Abstract
In this paper, an automatic invoice processing system, which is in great demand among private and public companies, was proposed. The proposed system supports all invoice file types that can be submitted by companies. Companies can easily submit invoices to the system via the web interface or email, and all invoices submitted to the system are queued and processed sequentially. If the invoice is a text file, the invoice information is extracted from the text by using template matching. If the invoice is an image, the text and table areas are detected and extracted. For table detection, we used both image processing based and YOLOv5-based deep learning method. Cell extraction was then performed from the extracted table images. As a result of these processes, all text and table cells were obtained as images and these images were converted into machine-readable text using the open-source software Tesseract OCR. Tesseract already provides trained models for English and Turkish. However, these models do not provide successful results for invoices submitted by companies in Turkish. Therefore, the new fine-tuned model trained with invoices in Turkish was used for OCR. The experimental results showed that the trained Turkish model was more accurate than the Turkish and English models provided by Tesseract. In addition, the YOLOv5-based table detection model was more accurate than the image-processing-based table detection method.Keywords
This publication has 32 references indexed in Scilit:
- Mask R-CNN2017
- Texture feature benchmarking and evaluation for historical document image analysisInternational Journal on Document Analysis and Recognition (IJDAR), 2017
- A Table Detection Method for PDF Documents Based on Convolutional Neural Networks2016
- A Survey on Document Image Processing Methods Useful for Assistive Technology for the BlindInternational Journal of Image and Graphics, 2015
- Layout analysis and content enrichment of digitized booksMultimedia Tools and Applications, 2014
- Field Extraction from Administrative Documents by Incremental Structural Templates2013
- Scene Text Extraction Using Image Intensity and Color Information2009
- Automatic Table Detection in Document Images2005
- A survey of the hough transformComputer Vision, Graphics, and Image Processing, 1988
- ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURECartographica, 1973