MHFS-FORMER: Multiple-Scale Hybrid Features Transformer for Lane Detection
Open Access
Abstract
Although deep learning has exhibited remarkable performance in lane detection, lane detection remains challenging in complex scenarios, including those with damaged lane markings, obstructions, and insufficient lighting. Furthermore, a significant drawback of most existing lane-detection algorithms lies in their reliance on complex post-processing and strong prior knowledge. Inspired by the DETR architecture, we propose an end-to-end Transformer-based model, MHFS-FORMER, to resolve these issues. To tackle the interference with lane detection in complex scenarios, we have designed MHFNet. It fuses multi-scale features with the Transformer Encoder to obtain enhanced multi-scale features. These enhanced multi-scale features are then fed into the Transformer Decoder. A novel multi-reference deformable attention module is introduced to disperse the attention around the objects to enhance the model’s representation ability during the training process and better capture the elongated structure of lanes and the global environment. We also designed ShuffleLaneNet, which meticulously explores the channel and spatial information of multi-scale lane features, significantly improving the accuracy of target recognition. Our method has achieved an accuracy score of 96.88%, a real-time processing speed of 87 fps on the TuSimple dataset, and an F1 score of 77.38% on the CULane dataset. Compared with the methods based on CNN and those based on Transformer, our method has demonstrated excellent performance.Keywords
This publication has 23 references indexed in Scilit:
- Laneformer: Object-Aware Row-Column Transformers for Lane DetectionProceedings of the AAAI Conference on Artificial Intelligence, 2022
- Ultra Fast Deep Lane Detection With Hybrid Anchor Driven Ordinal ClassificationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2022
- LaneAF: Robust Multi-Lane Detection With Affinity FieldsIEEE Robotics and Automation Letters, 2021
- Key Points Estimation and Point Instance Segmentation Approach for Lane DetectionIEEE Transactions on Intelligent Transportation Systems, 2021
- Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection2021
- End-to-End Object Detection with Transformers2020
- Line-CNN: End-to-End Traffic Line Detection With Line Proposal UnitIEEE Transactions on Intelligent Transportation Systems, 2019
- CBAM: Convolutional Block Attention Module2018
- Spatial as Deep: Spatial CNN for Traffic Scene UnderstandingProceedings of the AAAI Conference on Artificial Intelligence, 2018
- Robust Lane Detection and Tracking in Challenging ScenariosIEEE Transactions on Intelligent Transportation Systems, 2008