Mobile ID Document Recognition–Coarse-to-Fine Approach
- 18 March 2022
- journal article
- research article
- Published by Pleiades Publishing Ltd in Pattern Recognition and Image Analysis
- Vol. 32 (1) , 89-108
Abstract
Automatic optical recognition of documents is a traditional function of modern document processing systems. In this context, recognition represents a complex process which includes image processing, segmentation, classification, and linguistic analysis. Although the idea of using mobile devices for recognition of paper documents is not new, direct usage of existing software solutions for scanned images recognition yields low recognition precision on images obtained using a mobile device. This is due, first of all, to perspective distortions and lower effective resolution in the latter case. In this paper, we present an original approach and a set of algorithms for recognition of video frame sequence containing a document image, which is suitable for mobile implementation. It is based on a coarse-to-fine methodology, where template matching and fields localization are performed on the image with lowered resolution, followed by lazy processing of parts of the images only corresponding to the fields which are not recognized yet. Video stream is utilized as a source of noise reduction both in coordinates of the fields and optical character recognition classifiers outputs. The algorithm based on the proposed approach is suitable for running on the device itself and can operate even when none of the video frames contain a document image of sufficient quality by themselves.Keywords
This publication has 68 references indexed in Scilit:
- Reading Text in the Wild with Convolutional Neural NetworksInternational Journal of Computer Vision, 2015
- Mobile Phone Camera-Based Video Scanning of Paper Documents2014
- Seven Challenges in Image Quality Assessment: Past, Present, and Future ResearchISRN Signal Processing, 2013
- Hough Transform: Underestimated Tool In The Computer Vision Field2008
- A survey of document image classification: problem statement, classifier architecture and performance evaluationInternational Journal on Document Analysis and Recognition (IJDAR), 2006
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- Text information extraction in images and video: a surveyPattern Recognition, 2004
- Twenty years of document image analysis in PAMIIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- A survey of methods and strategies in character segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Random sample consensusCommunications of the ACM, 1981