Multispectral Fusion Approach for Traffic Target Detection in Bad Weather
Open Access
- 28 October 2020
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 13 (11) , 271
Abstract
Visual traffic surveillance using computer vision techniques can be noninvasive, automated and cost effective. Traffic surveillance systems with the ability to detect, count and classify vehicles can be employed in gathering traffic statistics and achieving better traffic control in intelligent transportation systems. This works well in daylight when the road users are clearly visible to the camera, but it often struggles when the visibility of the scene is impaired by insufficient lighting or bad weather conditions such as rain, snow, haze and fog. Therefore, in this paper, we design a dual input faster region-based convolutional neural network (RCNN) to make full use of the complementary advantages of color and thermal images to detect traffic objects in bad weather. Different from the previous detector, we used halfway fusion to fuse color and thermal images for traffic object detection. Besides, we adopt the polling from multiple layers method to adapt the characteristics of large size differences between objects of traffic targets to accurately identify targets of different sizes. The experimental results show that the present method improves the target recognition accuracy by 7.15% under normal weather conditions and 14.2% under bad weather conditions. This exhibits promising potential for implementation with real-world applications.Keywords
This publication has 21 references indexed in Scilit:
- Infrared and visible image fusion methods and applications: A surveyInformation Fusion, 2019
- Rain Removal in Traffic Surveillance: Does it Matter?IEEE Transactions on Intelligent Transportation Systems, 2018
- Traffic surveillance and speed limit violation detection systemJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology, 2017
- SSD: Single Shot MultiBox Detector2016
- Vehicle detection and recognition for intelligent traffic surveillance systemMultimedia Tools and Applications, 2015
- Vehicle Classification with Confidence by Classified Vector QuantizationIEEE Intelligent Transportation Systems Magazine, 2013
- Learning affinities and dependencies for multi-target tracking using a CRF model2011
- Face recognition by fusing thermal infrared and visible imageryImage and Vision Computing, 2006
- Automatic Traffic Surveillance System for Vehicle Tracking and ClassificationIEEE Transactions on Intelligent Transportation Systems, 2006
- Fusion of Thermal Infrared and Visible Spectrum Video for Robust Surveillance2006