Robust Signboard Detection and Recognition in Real Environments
- 15 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 69 (3) , 421-430
Abstract
The detection and recognition of signboards have become increasingly important in the consumer electronics industry due to its wide range of potential applications. These applications include aiding visually impaired consumers in navigating through unfamiliar areas, identifying location landmarks for wayfinding, and providing targeted advertising and marketing services to consumers. However, the accuracy of signboard detection remains challenging due to the diversity of designs, which may incorporate text and images, and the complexity of environments, such as occlusion, shooting angles, and lighting conditions. Most existing detection methods struggle to distinguish small and similar signboards. In this paper, we propose robust signboard detection and recognition based on template generation. We also collected a new dataset that contains about 30,000 images, in 14 categories of signboards in Taiwan for training and free public use. The proposed method is a one-stage detector, which utilizes multi-scale features in the Darknet-19 network to learn object features effectively, detecting tiny and large objects. In addition, the proposed template generation method was designed to improve the overall accuracy. We compare our results with the Yolo series models. The results show that our proposed method more efficiently detects and recognizes signboards, achieving an mAP score of 95.99%, total parameters of 62.7M, and FPS of 8.3.Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (110-2221-E-155-039-MY3, MOST 109-2634-F-008-007, MOST 111-2221-E-155-039-MY3)
This publication has 33 references indexed in Scilit:
- Cascade R-CNN: Delving Into High Quality Object Detection2018
- Signboard Text Translator: A Guide to TouristInternational Journal of Electrical and Computer Engineering (IJECE), 2017
- DSOD: Learning Deeply Supervised Object Detectors from Scratch2017
- Focal Loss for Dense Object Detection2017
- Mask R-CNN2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- YOLO9000: Better, Faster, Stronger2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015