Enforcing similarity constraints with integer programming for better scene text recognition
Authors:
- 1 June 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 73-80
Abstract
The recognition of text in everyday scenes is made difficult by viewing conditions, unusual fonts, and lack of linguistic context. Most methods integrate a priori appearance information and some sort of hard or soft constraint on the allowable strings. Weinman and Learned-Miller showed that the similarity among characters, as a supplement to the appearance of the characters with respect to a model, could be used to improve scene text recognition. In this work, we make further improvements to scene text recognition by taking a novel approach to the incorporation of similarity. In particular, we train a similarity expert that learns to classify each pair of characters as equivalent or not. After removing logical inconsistencies in an equivalence graph, we formulate the search for the maximum likelihood interpretation of a sign as an integer program. We incorporate the equivalence information as constraints in the integer program and build an optimization criterion out of appearance features and character bigrams. Finally, we take the optimal solution from the integer program, and compare all “nearby” solutions using a probability model for strings derived from search engine queries. We demonstrate word error reductions of more than 30% relative to previous methods on the same data set.Keywords
This publication has 13 references indexed in Scilit:
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Is that you? Metric learning approaches for face identification2009
- Attribute and simile classifiers for face verification2009
- Scene Text Recognition Using Similarity and a Lexicon with Sparse Belief PropagationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Improving Recognition of Novel Input with Similarity2006
- Lexical postcorrection of OCR-results:the web as a dynamic secondary dictionary?2005
- ICDAR 2003 robust reading competitions2005
- Segmentation and recognition of characters in scene images using selective binarization in color space and GAT correlation2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Enhancing degraded document images via bitmap clustering and averaging2002