Text Spotting for Curved Metal Surface: Clustering, Fitting, and Rectifying
- 7 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456) , 1-12
Abstract
In the machining system, how to recognize text on the curved metal surface of parts is still a challenging question. In this paper, a text spotting framework for curved metal surface based on image rectification and CNN is proposed. First, a curved text rectification method through CNN-based detection and text curve fitting is investigated. The CNN model for text detection is trained on the original images, which is used to obtain the location of characters of the text. The characters are clustered based on location and size, and the text line is fitted based on the centers of characters that belong to the same cluster. The text image is expanded according to the fitting text line, which finishes the rectification of the curve text image. Second, plenty of original text images are rectified by the proposed rectification method to construct the training dataset. Third, in the recognition stage, an original text image is rectified and used as the input of CNN recognition model. In the experiments, after comparing the detection performance between YOLOv3, Faster R-CNN, SSD-ResNet101 and RetinaNet101, RetinaNet101 was chosen as the text detector. Also, the recognition results on the rectification training set and test set generated by the proposed framework are better than those on the original image datasets. The experimental results show that the proposed method can achieve competitive results text spotting for curved metal surface.Keywords
Funding Information
- National Natural Science Foundation of China (61976193)
- Zhejiang Provincial Science and Technology Planning Key Project of China (2018C01064)
- Zhejiang Provincial Natural Science Foundation of China (LY19F020027)
This publication has 39 references indexed in Scilit:
- Adaptable Ring for Vision-Based Measurements and Shape AnalysisIEEE Transactions on Instrumentation and Measurement, 2017
- An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Detecting Text in Natural Image with Connectionist Text Proposal Network2016
- Robust Scene Text Recognition with Automatic Rectification2016
- Synthetic Data for Text Localisation in Natural Images2016
- A vision-based system for post-welding quality measurement and defect detectionThe International Journal of Advanced Manufacturing Technology, 2016
- Camera as the instrument: the rising trend of vision based measurementIEEE Instrumentation & Measurement Magazine, 2014
- Deep Features for Text Spotting2014
- Scene Text Localization and Recognition with Oriented Stroke Detection2013
- Notice of Violation of IEEE Publication Principles: Modified Syntactic Method to Recognize Bengali Handwritten CharactersIEEE Transactions on Instrumentation and Measurement, 2007