Autonomous Planning and Control for Intelligent Vehicles in Traffic
- 4 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 21 (6) , 2339-2349
Abstract
This paper addresses the trajectory planning problem for autonomous vehicles in traffic. We build a stochastic Markov decision process (MDP) model to represent the behaviors of the vehicles. This MDP model takes into account the road geometry and is able to reproduce more diverse driving styles. We introduce a new concept, namely, the ''dynamic cell,'' to dynamically modify the state of the traffic according to different vehicle velocities, driver intents (signals), and the sizes of the surrounding vehicles (i.e., truck, sedan, and so on). We then use Bézier curves to plan smooth paths for lane switching. The maximum curvature of the path is enforced via certain design parameters. By designing suitable reward functions, different desired driving styles of the intelligent vehicle can be achieved by solving a reinforcement learning problem. The desired driving behaviors (i.e., autonomous highway overtaking) are demonstrated with an in-house developed traffic simulator.Keywords
Funding Information
- National Science Foundation (CPS-1544814)
- Ford Motor Company
This publication has 25 references indexed in Scilit:
- Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directionsTransportation Research Part C: Emerging Technologies, 2015
- Road Centerline Extraction in Complex Urban Scenes From LiDAR Data Based on Multiple FeaturesIEEE Transactions on Geoscience and Remote Sensing, 2014
- Autonomous vehicle collision avoidance system using path planning and model-predictive-control-based active front steering and wheel torque controlProceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 2012
- Sampling-based algorithms for optimal motion planningThe International Journal of Robotics Research, 2011
- Optimal motion planning by reinforcement learning in autonomous mobile vehiclesRobotica, 2011
- Aerodynamic parameter estimation from flight data applying extended and unscented Kalman filterAerospace Science and Technology, 2010
- Steady-state cornering equilibria and stabilisation for a vehicle during extreme operating conditionsInternational Journal of Vehicle Autonomous Systems, 2010
- From Reeds and Shepp's to Continuous-Curvature PathsIEEE Transactions on Robotics, 2004
- Apprenticeship learning via inverse reinforcement learning2004
- The Linear Multivariable Regulator ProblemSIAM Journal on Control and Optimization, 1977