An Impact of OCR Errors on Automated Classification of OCR Japanese Texts with Parts-of-Speech Analysis
Authors:
- Akihiro KokawaAKAkihiro Kokawa
- Lazaro S.P. BusagalaLBLazaro S.P. Busagala
- Wataru OhyamaWOWataru Ohyama
- Tetsushi WakabayashiTWTetsushi Wakabayashi
- Fumitaka KimuraFKFumitaka Kimura
- 1 September 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 543-547
Abstract
The technology of Optical Character Recognition (OCR) is used to generate texts in the process of digitizing print documents. Usually these texts need to be indexed and organized to simplify their access and retrieval. One of the powerful approaches in accomplishing this task is the use of Automated Text Classification. However, it is currently impossible for OCR technology to recognize all characters with an accuracy of 100%. We therefore propose the use of combined linguistic features in automated classification of OCR texts to formulate an informative feature set. The proposed method was experimentally evaluated using Japanese OCR texts. Empirical results indicate that the combination of linguistic features improved classification performance of OCR texts.Keywords
This publication has 11 references indexed in Scilit:
- The Impact of OCR Accuracy and Feature Transformation on Automatic Text ClassificationLecture Notes in Computer Science, 2006
- Some statistical issues in the comparison of speech recognition algorithms2003
- The use of bigrams to enhance text categorizationInformation Processing & Management, 2002
- Machine learning in automated text categorizationACM Computing Surveys, 2002
- Text categorization for multi-page documents2001
- A re-examination of text categorization methods1999
- An Evaluation of Statistical Approaches to Text CategorizationInformation Retrieval Journal, 1999
- A part of speech estimation method for Japanese unknown words using a statistical model of morphology and context1999
- Approximate Statistical Tests for Comparing Supervised Classification Learning AlgorithmsNeural Computation, 1998
- A stochastic Japanese morphological analyzer using a forward-DP backward-A* N-best search algorithm1994