AI-Based Vehicle State Estimation Using Multi-Sensor Perception and Real-World Data
Open Access
Abstract
With the rise of vehicle automation, accurate estimation of driving dynamics has become crucial for ensuring safe and efficient operation. Vehicle dynamics control systems rely on these estimates to provide necessary control variables for stabilizing vehicles in various scenarios. Traditional model-based methods use wheel-related measurements, such as steering angle or wheel speed, as inputs. However, under low-traction conditions, e.g., on icy surfaces, these measurements often fail to deliver trustworthy information about the vehicle states. In such critical situations, precise estimation is essential for effective system intervention. This work introduces an AI-based approach that leverages perception sensor data, specifically camera images and lidar point clouds. By using relative kinematic relationships, it bypasses the complexities of vehicle and tire dynamics and enables robust estimation across all scenarios. Optical and scene flow are extracted from the sensor data and processed by a recurrent neural network to infer vehicle states. The proposed method is vehicle-agnostic, allowing trained models to be deployed across different platforms without additional calibration. Experimental results based on real-world data demonstrate that the AI-based estimator presented in this work achieves accurate and robust results under various conditions. Particularly in low-friction scenarios, it significantly outperforms conventional model-based approaches.Keywords
Funding Information
- DLR basic funding
This publication has 36 references indexed in Scilit:
- YOLOv1 to YOLOv10: The Fastest and Most Accurate Real-time Object Detection SystemsAPSIPA Transactions on Signal and Information Processing, 2024
- Vehicle side-slip angle estimation under snowy conditions using machine learningIntegrated Computer-Aided Engineering, 2024
- A Reliable Position Estimation Methodology Based on Multi-Source Information for Intelligent Vehicles in Unknown EnvironmentIEEE Transactions on Intelligent Vehicles, 2023
- Radar sensor based machine learning approach for precise vehicle position estimationScientific Reports, 2023
- 4DEgo: ego-velocity estimation from high-resolution radar dataFrontiers in Signal Processing, 2023
- Sensing and Machine Learning for Automotive Perception: A ReviewIEEE Sensors Journal, 2023
- Object Detection in 20 Years: A SurveyProceedings of the IEEE, 2023
- Coordinated control architecture for motion management in ADAS systemsIEEE/CAA Journal of Automatica Sinica, 2018
- Robust Multirate Control Scheme With Predictive Virtual Lanes for Lane-Keeping System of Autonomous Highway DrivingIEEE Transactions on Vehicular Technology, 2014
- Control Systems Integration for Enhanced Vehicle DynamicsThe Open Mechanical Engineering Journal, 2013