Click-Free, Video-Based Document Capture - Methodology and Evaluation
Authors:
- Waqas Tariq DarWDWaqas Tariq Dar
- Muhammad Nazar Amin KhanMKMuhammad Nazar Amin Khan
- 1 November 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 7, 21-26
Abstract
We propose a click-free method for video-based digitization of multi-page documents. The work is targeted at the non-commercial, low-volume, home user. The document is viewed through a mounted camera and the user is only required to turn pages manually while the system automatically extracts the video frames representing stationary document pages. This is in contrast to traditional document conversion approaches such as photocopying and scanning which can be time-consuming, repetitive, redundant and can lead to document deterioration. Main contributions of our work are i) a 3-step method for automatic extraction of unique, stable and clear document pages from video, ii) a manually annotated data set of 37 videos consisting of 763 page turn events covering a large variety of documents, and iii) a soft, quantitative evaluation criterion that is highly correlated with the hard F1-measure. The criterion is motivated by the need to counter the subjectivity in human marked ground truth for videos. On our data set, we report an F1-measure of 0.91 and a soft score of 0.94 for the page extraction task.Keywords
This publication has 11 references indexed in Scilit:
- Human-Document Interaction Systems -- A New Frontier for Document Image Analysis2016
- Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions2015
- On-the-fly hand detection training with application in egocentric action recognition2015
- A Sequential Classifier for Hand Detection in the Framework of Egocentric Vision2014
- Pixel-Level Hand Detection in Ego-centric Videos2013
- Rectification and 3D reconstruction of curved document images2011
- Goal-Oriented Rectification of Camera-Based Document ImagesIEEE Transactions on Image Processing, 2010
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- CamWorks: a video-based tool for efficient capture from paper source documents2003
- Twenty years of document image analysis in PAMIIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000