Customised OCR correction for historical medical text
Authors:
- 25 February 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 35-42
Abstract
Historical text archives constitute a rich and diverse source of information, which is becoming increasingly readily accessible, owing to large-scale digitisation efforts. Searchable access is typically provided by applying Optical Character Recognition (OCR) software to scanned page images. Often, however, the automatically recognised text contains a large number of errors, since OCR systems are typically optimised to deal with modern documents, and can struggle with historical document features, including variable print characteristics and archaic vocabulary usage. Low quality OCR text can reduce the efficiency of search systems over historical archives, particularly semantic systems that are based on the application of sophisticated text mining (TM) techniques. We report on a new OCR correction strategy, customised for historical medical documents. The method combines rule-based correction of regular errors with a medically-tuned spell-checking strategy, whose corrections are guided by information about subject-specific language usage from the publication period of the article to be corrected. The performance of our method compares favourably to other OCR post-correction strategies, in improving word-level accuracy of poor-quality documents by up to 16%.Keywords
This publication has 23 references indexed in Scilit:
- Large-Scale Event Extraction from Literature with Multi-Level Gene NormalizationPLOS ONE, 2013
- Ocropodium: open source OCR for small-scale historical archivesJournal of Information Science, 2011
- Character confusion versus focus word-based correction of spelling and OCR variants in corporaInternational Journal on Document Analysis and Recognition (IJDAR), 2010
- Optical character recognition errors and their effects on natural language processingInternational Journal on Document Analysis and Recognition (IJDAR), 2009
- Improving OCR Accuracy for Classical Critical Editions2009
- Non-interactive OCR Post-correction for Giga-Scale Digitization Projects2008
- Digital LondonProgram: electronic library and information systems, 2005
- Implementing the iHOP concept for navigation of biomedical literatureBioinformatics, 2005
- OCRSpell: an interactive spelling correction system for OCR errors in textInternational Journal on Document Analysis and Recognition (IJDAR), 2001
- Using Consensus Sequence Voting to Correct OCR ErrorsComputer Vision and Image Understanding, 1997