StrikeNet: Deep Convolutional LSTM-Based Road Lane Reconstruction With Spatiotemporal Inference for Lane Keeping Control
Open Access
- 8 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 97500-97514
Abstract
This paper presents a Spatio-Temporal Road Inference for a KEeping NETwork (StrikeNet), aimed at enhancing Road Lane Reconstruction (RLR) and lateral motion control in Autonomous Vehicles (AV) using deep neural networks. Accurate road lane model coefficients are essential for an effective Lane Keeping System (LKS), but the traditional vision system often fails in situations where lane markers are absent or faint and cannot be properly recognized. To overcome this, a driving dataset was restructured, combining road information from a vision system and forward images for spatial training of RLR. Sequential spatial learning outputs were then processed with in-vehicle sensor data for temporal inference via Long Short-Term Memory (LSTM). The StrikeNet was rigorously tested in both typical and uncertain driving environments. Comprehensive statistical and visualization analyses were conducted to evaluate the performance of various RLR methods and lateral motion control strategies. Remarkably, the RLR demonstrated its capability to derive reliable road coefficients even in the absence of lane markers. Upon performance comparison with four alternative techniques, our method yields the lowest error and variance between human steering inputs and the control input. Specifically, under high and low lane quality conditions, the proposed method maximally reduced the control input error by up to 72% and 66%, respectively, and decreased the variance by 54% and 94%, respectively. The findings highlight StrikeNet’s effectiveness in bolstering the fail-operational performance, and reliability of lane-keeping or lane departure warning systems in autonomous driving, thereby enhancing control continuity and mitigating path deviation-induced traffic accidents.Keywords
Funding Information
- National Research Foundation of Korea (NRF) Grant funded by Korean Government through Ministry of Science and Information and Communications Technology (MSIT) (2021R1A2C2009908)
- Accurate Autonomous Tracking Control by Unmatched Disturbance Compensator with Reference Re-Design Filter (RS-2023-00213640)
This publication has 36 references indexed in Scilit:
- Robust Tracking Control for Quadrotor UAV With External Disturbances and Uncertainties Using Neural Network Based MRACIEEE Access, 2024
- End-to-end deep learning of lane detection and path prediction for real-time autonomous drivingSignal, Image and Video Processing, 2022
- Incremental End-to-End Learning for Lateral Control in Autonomous DrivingIEEE Access, 2022
- A Survey on Deep Learning for Steering Angle Prediction in Autonomous VehiclesIEEE Access, 2020
- Explaining Autonomous Driving by Learning End-to-End Visual Attention2020
- Kinematics-based Fault-tolerant Techniques: Lane Prediction for an Autonomous Lane Keeping SystemInternational Journal of Control, Automation, and Systems, 2018
- Deep Neural Networks in a Mathematical Framework2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- Robust Lane Detection using Two-stage Feature Extraction with Curve FittingPattern Recognition, 2016
- DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks2016