Vehicle-Road Environment Perception Under Low-Visibility Condition Based on Polarization Features via Deep Learning
- 5 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 23 (10) , 17873-17886
Abstract
Visual perception system is the key component of safety driving assistance and unmanned driving systems, and the perceptive performance of which will directly affect the running safety. There are various perception algorithms for the visual system, especially in recent years, deep learning algorithms are adopted with increasing popularity among them. However, the majority of existing works mainly focuses on daytime scenes with favorable illumination and weather conditions, and relies on visible light with intensity imaging equipment. This paper is based on polarization features acquired by deep learning methods, attempting to address the problems about vehicle-road environment perception in Low-Visibility Condition. Polarization is one of the essential properties of matter, here we propose a new method by studying and analyzing the transmission characteristics of the target’s polarization information. In the proposed method, the polarization features of vehicle-road environment are first acquired by a kind of three-channel polarization imaging device, then, fused together with an intensity image, and finally followed by a semantic segmentation operation by deep networks. The experimental results clearly demonstrate that the effect of perception based on polarization features via deep learning are greatly improved compared with intensity imaging, especially in low illumination and severe weather conditions. It is of great value for environmental robustness of visual perception system and further traffic safety.Keywords
Funding Information
- National Natural Science Foundation of China (52172324)
- Shaanxi Provincial Key Research and Development Program (2021GY-285, 2021SF-483)
- Science and Technology Project of Shaanxi Provincial Transportation Department (21-20K)
This publication has 22 references indexed in Scilit:
- A novel approach in real-time vehicle detection and tracking using Raspberry PiAlexandria Engineering Journal, 2018
- Combining CNN and MRF for road detectionComputers and Electrical Engineering, 2018
- Deep detection network for real-life traffic sign in vehicular networksComputer Networks, 2018
- Lane marking detection via deep convolutional neural networkNeurocomputing, 2017
- Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detectionNeural Networks, 2017
- Traffic sign detection and recognition using fully convolutional network guided proposalsNeurocomputing, 2016
- Vehicle Color Recognition With Spatial Pyramid Deep LearningIEEE Transactions on Intelligent Transportation Systems, 2015
- Multi-view traffic sign detection, recognition, and 3D localisationMachine Vision and Applications, 2011
- Stokes vector component versus elementary factor performance in a target detection algorithm2004
- Computer Simulation of Impurity Diffusion in Semiconductors by the Monte Carlo MethodIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 1987