Creating an Improved Version Using Noisy OCR from Multiple Editions
Authors:
- David WemhoenerDWDavid Wemhoener
- Ismet Zeki YalnizIYIsmet Zeki Yalniz
- R. ManmathaRMR. Manmatha
- 1 August 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15205363,p. 160-164
Abstract
This paper evaluates an automated scheme for aligning and combining optical character recognition (OCR) output from three scans of a book to generate a composite version with fewer OCR errors. While there has been some previous work on aligning multiple OCR versions of the same scan, the scheme introduced in this paper does not require that scans be from the same copy of the book, or even the same edition. The three OCR outputs are combined using an algorithm which builds upon an technique which aligns two sequences at a time. In the algorithm a multiple sequence alignment of the scans is generated by stitching together pair wise alignments and is used in turn to construct a corrected text. The approach is able to correct OCR errors so long as they do not occur in multiple scans. The proposed approach is shown to be effective even if some of the books contain additional content such as introductions or commentary. This scheme is used to generate improved versions from OCR texts taken from the Internet Archive. The accuracy of the original scans and the composite text are evaluated by comparing them to the version available from Project Gutenberg.Keywords
This publication has 5 references indexed in Scilit:
- A Fast Alignment Scheme for Automatic OCR Evaluation of Books2011
- Alignment of whole genomesNucleic Acids Research, 1999
- Comprehensive study on iterative algorithms of multiple sequence alignmentBioinformatics, 1995
- CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choiceNucleic Acids Research, 1994
- Techniques for automatically correcting words in textACM Computing Surveys, 1992