Enhanced Safety in Autonomous Driving: Integrating a Latent State Diffusion Model for End-to-End Navigation
Open Access
Abstract
Ensuring safety in autonomous driving is crucial for effective motion planning and navigation. However, most end-to-end planning methodologies lack sufficient safety measures. This study tackles this issue by formulating the control optimization problem in autonomous driving as Constrained Markov Decision Processes (CMDPs). We introduce an innovative, model-based approach for policy optimization, employing a conditional Value-at-Risk (VaR)-based soft actor-critic (SAC) to handle constraints in complex, high-dimensional state spaces. Our method features a worst-case actor to ensure strict compliance with safety requirements, even in unpredictable scenarios. The policy optimization leverages the augmented Lagrangian method and leverages latent diffusion models to forecast and simulate future trajectories. This dual strategy ensures safe navigation through environments and enhances policy performance by incorporating distribution modeling to address environmental uncertainties. Empirical evaluations conducted in both simulated and real environments demonstrate that our approach surpasses existing methods in terms of safety, efficiency, and decision-making capabilities.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62372148)
This publication has 27 references indexed in Scilit:
- Control Barrier Functions and Input-to-State Safety With Application to Automated VehiclesIEEE Transactions on Control Systems Technology, 2023
- Sim-to-real transfer and reality gap modeling in model predictive control for autonomous drivingApplied Intelligence, 2022
- Stochastic Model Predictive Control With a Safety Guarantee for Automated DrivingIEEE Transactions on Intelligent Vehicles, 2021
- Deep Reinforcement Learning for Autonomous Driving: A SurveyIEEE Transactions on Intelligent Transportation Systems, 2021
- Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement LearningIEEE Transactions on Intelligent Transportation Systems, 2021
- Safe Reinforcement Learning Using Robust MPCIEEE Transactions on Automatic Control, 2020
- Multimodal End-to-End Autonomous DrivingIEEE Transactions on Intelligent Transportation Systems, 2020
- A Survey of Autonomous Driving: Common Practices and Emerging TechnologiesIEEE Access, 2020
- Latent Space Models for Dynamic NetworksJournal of the American Statistical Association, 2015
- Human-level control through deep reinforcement learningNature, 2015