Character-Aware Sampling and Rectification for Scene Text Recognition
- 22 November 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 25 (15209210) , 649-661
Abstract
Curved scene text recognition is a challenging task due to large shape and texture variance. Previous methods address this challenge by extracting and rectifying text line with equidistantly sampling, which ignore character level information and lead to distorted characters. To address this issue, this paper proposes a Character-Aware Sampling and Rectification (CASR) module, which rectifies irregular text instance according to the location and orientation information of each individual character. Specifically, CASR regards each character as a basic unit and predicts the character-level attributes for sampling and rectification. Our module not only exploits detailed character information to obtain better rectification of text line, but also employs character-level supervision in training process. In addition, CASR provides a plug-and-play module which can be easily incorporated to existing text recognition pipeline. Extensive experiments on several benchmarks demonstrate that our method obtains more accurate rectified text instances and achieves promising performance.Keywords
Funding Information
- National Natural Science Foundation of China (6163302)
- Shenzhen Research Program (JSGG20191129141212311)
- Shanghai Committee of Science, and Technology, China (20DZ1100800)
This publication has 55 references indexed in Scilit:
- Scene text recognition using a Hough forest implicit shape model and semi-Markov conditional random fieldsPattern Recognition, 2015
- Reading Text in the Wild with Convolutional Neural NetworksInternational Journal of Computer Vision, 2015
- A robust arbitrary text detection system for natural scene imagesExpert Systems with Applications, 2014
- A Unified Framework for Multioriented Text Detection and RecognitionIEEE Transactions on Image Processing, 2014
- Word Spotting and Recognition with Embedded AttributesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Deep Features for Text Spotting2014
- Large-Lexicon Attribute-Consistent Text Recognition in Natural Images2012
- Connectionist temporal classification2006
- NOVELNEURALMODULATORSAnnual Review of Neuroscience, 2003
- Principal warps: thin-plate splines and the decomposition of deformationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989