MR-CNN: A Multi-Scale Region-Based Convolutional Neural Network for Small Traffic Sign Recognition
Authors:
Open Access
- 29 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 57120-57128
Abstract
Small traffic sign recognition is a challenging problem in computer vision, and its accuracy is important to the safety of intelligent transportation systems (ITS). In this paper, we propose the multi-scale region-based convolutional neural network (MR-CNN). At the detection stage, MR-CNN uses a multi-scale deconvolution operation to up-sample the features of the deeper convolution layers and concatenates them to those of the shallow layer to construct the fused feature map. The fused feature map has the ability to generate fewer region proposals and achieve higher recall values. At the classification stage, we leverage the multi-scale contextual regions to exploit the information surrounding a given object proposal and construct the fused feature for the fully connected layers. The fused feature map inside the region proposal network (RPN) focuses primarily on improving the image resolution and semantic information for small traffic sign detection, while outside the RPN, the fused feature enhances the feature representation by leveraging the contextual information. Finally, we evaluated MR-CNN on the largest dataset, Tsinghua-Tencent 100K, which is suitable for our problem and more challenging than the GTSDB and GTSRB datasets. The final experimental results indicate that the MR-CNN is superior at detecting small traffic signs, and that it achieves the state-of-the-art performance compared with other methods.Keywords
Funding Information
- National Natural Science Foundation of China (61502094, 51774090, 51104030)
- Natural Science Foundation of Heilongjiang Province (F2016002, E2016008, F2015020)
- Northeast Petroleum University (2017PYZL-06, 2018YDL-22)
This publication has 32 references indexed in Scilit:
- Traffic sign detection and recognition using fully convolutional network guided proposalsNeurocomputing, 2016
- Traffic Sign Recognition via Multi-Modal Tree-Structure Embedded Multi-Task LearningIEEE Transactions on Intelligent Transportation Systems, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Occlusion‐robust traffic sign detection via cascaded colour cubic featureIET Intelligent Transport Systems, 2016
- On circular traffic sign detection and recognitionExpert Systems with Applications, 2016
- An Efficient Method for Traffic Sign Recognition Based on Extreme Learning MachineIEEE Transactions on Cybernetics, 2016
- Towards Real-Time Traffic Sign Detection and ClassificationIEEE Transactions on Intelligent Transportation Systems, 2015
- Traffic sign recognition — How far are we from the solution?2013
- Detection of traffic signs in real-world images: The German traffic sign detection benchmark2013
- The German Traffic Sign Recognition Benchmark: A multi-class classification competition2011