LaneTD: Lane Feature Aggregator Based on Transformer and Dilated Convolution
- 22 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 23 (7) , 7371-7380
Abstract
Deep-Learning-Based algorithms successfully improve the detection accuracy of traffic lanes. Most of them employed stacked convolutional neural networks( CNNs) to extract semantics, but they have trouble gathering global visual information. What’s more, the stacked CNNs perform multiple down-sampling, which reduce the resolution of feature map, causing the tiny features easy to be ignored. To address these problems, LaneTD is proposed: a novel lane feature aggregator that extracts and fuses local and global features. This method adopts dilated convolution to extract local features of various scales, and enhances global representation base on transformer encoder. The local and global information are then weighted fused using bidirectional feature pyramid. In addition, we apply unsupervised image style transfer to improve the performance in nighttime and dark scenarios. The method is quantitatively evaluated on public challenging CULane dataset, the result shows that the proposed method significantly improves the accuracy and computational efficiency of lane detection in different scenarios. Furthermore, an ablation study is carried out, as well as a discussion of efficiency trade-off choices that can be applied in practice.Keywords
Funding Information
- Research and Development Program of Key Science and Technology Fields in Guangdong Province (2019B090912001)
- Guangzhou Key Field Research and Development Program (202206030005)
This publication has 35 references indexed in Scilit:
- Semantic Segmentation-Based Lane-Level Localization Using Around View Monitoring SystemIEEE Sensors Journal, 2019
- Path Aggregation Network for Instance Segmentation2018
- Lane Detection and Classification for Forward Collision Warning System Based on Stereo VisionIEEE Sensors Journal, 2018
- VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Feature Pyramid Networks for Object Detection2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Image Style Transfer Using Convolutional Neural Networks2016
- Deep Residual Learning for Image Recognition2016
- Learning Deep Features for Discriminative Localization2016